2023-09-19 20:01:06,234 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-09-19 20:01:06,464 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59 2023-09-19 20:01:06,464 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-09-19 20:01:06,465 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-09-19 20:01:06,508 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-09-19 20:01:06,775 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-09-19 20:01:06,775 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59/cluster_89d21045-e502-a291-a4eb-07ce7438eb28, deleteOnExit=true 2023-09-19 20:01:06,776 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-09-19 20:01:06,776 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59/test.cache.data in system properties and HBase conf 2023-09-19 20:01:06,777 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59/hadoop.tmp.dir in system properties and HBase conf 2023-09-19 20:01:06,777 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59/hadoop.log.dir in system properties and HBase conf 2023-09-19 20:01:06,778 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59/mapreduce.cluster.local.dir in system properties and HBase conf 2023-09-19 20:01:06,779 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-09-19 20:01:06,779 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-09-19 20:01:07,115 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-09-19 20:01:07,120 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-09-19 20:01:07,120 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-09-19 20:01:07,120 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-09-19 20:01:07,121 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-19 20:01:07,121 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-09-19 20:01:07,122 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-09-19 20:01:07,122 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-19 20:01:07,123 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-19 20:01:07,123 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-09-19 20:01:07,124 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59/nfs.dump.dir in system properties and HBase conf 2023-09-19 20:01:07,124 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59/java.io.tmpdir in system properties and HBase conf 2023-09-19 20:01:07,124 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-19 20:01:07,125 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-09-19 20:01:07,125 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-09-19 20:01:07,642 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-09-19 20:01:07,647 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-09-19 20:01:07,971 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-09-19 20:01:08,150 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-09-19 20:01:08,164 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-19 20:01:08,203 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-09-19 20:01:08,238 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59/java.io.tmpdir/Jetty_localhost_45955_hdfs____.mshwpq/webapp 2023-09-19 20:01:08,388 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45955 2023-09-19 20:01:08,432 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-09-19 20:01:08,433 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-09-19 20:01:08,925 WARN [Listener at localhost/38739] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-19 20:01:08,996 WARN [Listener at localhost/38739] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-19 20:01:09,016 WARN [Listener at localhost/38739] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-19 20:01:09,024 INFO [Listener at localhost/38739] log.Slf4jLog(67): jetty-6.1.26 2023-09-19 20:01:09,031 INFO [Listener at localhost/38739] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59/java.io.tmpdir/Jetty_localhost_38471_datanode____ulb84w/webapp 2023-09-19 20:01:09,127 INFO [Listener at localhost/38739] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38471 2023-09-19 20:01:09,582 WARN [Listener at localhost/41565] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-19 20:01:09,605 WARN [Listener at localhost/41565] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-19 20:01:09,609 WARN [Listener at localhost/41565] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-19 20:01:09,611 INFO [Listener at localhost/41565] log.Slf4jLog(67): jetty-6.1.26 2023-09-19 20:01:09,623 INFO [Listener at localhost/41565] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59/java.io.tmpdir/Jetty_localhost_38687_datanode____.s1sfs9/webapp 2023-09-19 20:01:09,741 INFO [Listener at localhost/41565] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38687 2023-09-19 20:01:09,753 WARN [Listener at localhost/43449] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-19 20:01:09,769 WARN [Listener at localhost/43449] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-19 20:01:09,773 WARN [Listener at localhost/43449] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-19 20:01:09,776 INFO [Listener at localhost/43449] log.Slf4jLog(67): jetty-6.1.26 2023-09-19 20:01:09,785 INFO [Listener at localhost/43449] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59/java.io.tmpdir/Jetty_localhost_44433_datanode____.vkqgw5/webapp 2023-09-19 20:01:09,908 INFO [Listener at localhost/43449] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44433 2023-09-19 20:01:09,924 WARN [Listener at localhost/45791] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-19 20:01:10,191 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd5f9adebe30f3080: Processing first storage report for DS-b8595a0b-04ed-453f-98c5-2357642c2198 from datanode 604c5182-fbdd-4326-8b53-d13180e22499 2023-09-19 20:01:10,193 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd5f9adebe30f3080: from storage DS-b8595a0b-04ed-453f-98c5-2357642c2198 node DatanodeRegistration(127.0.0.1:40747, datanodeUuid=604c5182-fbdd-4326-8b53-d13180e22499, infoPort=45151, infoSecurePort=0, ipcPort=41565, storageInfo=lv=-57;cid=testClusterID;nsid=543903306;c=1695153667733), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-09-19 20:01:10,193 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xdb23e6aa5bec647a: Processing first storage report for DS-75546988-adb7-4d6b-a318-ee669a29a76e from datanode d7d864b1-2401-4e90-9a0e-ab3af3d8c6f1 2023-09-19 20:01:10,194 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xdb23e6aa5bec647a: from storage DS-75546988-adb7-4d6b-a318-ee669a29a76e node DatanodeRegistration(127.0.0.1:43319, datanodeUuid=d7d864b1-2401-4e90-9a0e-ab3af3d8c6f1, infoPort=41765, infoSecurePort=0, ipcPort=43449, storageInfo=lv=-57;cid=testClusterID;nsid=543903306;c=1695153667733), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-19 20:01:10,194 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xbf6b6e8271c1e1e3: Processing first storage report for DS-d00bd8bd-0bea-4f74-a740-9320075799e8 from datanode 0c004ae8-c20b-4b37-8525-5530d9cc8978 2023-09-19 20:01:10,194 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xbf6b6e8271c1e1e3: from storage DS-d00bd8bd-0bea-4f74-a740-9320075799e8 node DatanodeRegistration(127.0.0.1:34015, datanodeUuid=0c004ae8-c20b-4b37-8525-5530d9cc8978, infoPort=36351, infoSecurePort=0, ipcPort=45791, storageInfo=lv=-57;cid=testClusterID;nsid=543903306;c=1695153667733), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-19 20:01:10,194 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd5f9adebe30f3080: Processing first storage report for DS-620538de-396f-4c26-8ac2-d92c031798a0 from datanode 604c5182-fbdd-4326-8b53-d13180e22499 2023-09-19 20:01:10,194 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd5f9adebe30f3080: from storage DS-620538de-396f-4c26-8ac2-d92c031798a0 node DatanodeRegistration(127.0.0.1:40747, datanodeUuid=604c5182-fbdd-4326-8b53-d13180e22499, infoPort=45151, infoSecurePort=0, ipcPort=41565, storageInfo=lv=-57;cid=testClusterID;nsid=543903306;c=1695153667733), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-19 20:01:10,194 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xdb23e6aa5bec647a: Processing first storage report for DS-42adc2d5-0738-4b50-8559-6ac30f4163da from datanode d7d864b1-2401-4e90-9a0e-ab3af3d8c6f1 2023-09-19 20:01:10,194 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xdb23e6aa5bec647a: from storage DS-42adc2d5-0738-4b50-8559-6ac30f4163da node DatanodeRegistration(127.0.0.1:43319, datanodeUuid=d7d864b1-2401-4e90-9a0e-ab3af3d8c6f1, infoPort=41765, infoSecurePort=0, ipcPort=43449, storageInfo=lv=-57;cid=testClusterID;nsid=543903306;c=1695153667733), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-19 20:01:10,194 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xbf6b6e8271c1e1e3: Processing first storage report for DS-5d9c4496-aab1-48af-b8ca-896b005a4604 from datanode 0c004ae8-c20b-4b37-8525-5530d9cc8978 2023-09-19 20:01:10,195 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xbf6b6e8271c1e1e3: from storage DS-5d9c4496-aab1-48af-b8ca-896b005a4604 node DatanodeRegistration(127.0.0.1:34015, datanodeUuid=0c004ae8-c20b-4b37-8525-5530d9cc8978, infoPort=36351, infoSecurePort=0, ipcPort=45791, storageInfo=lv=-57;cid=testClusterID;nsid=543903306;c=1695153667733), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-19 20:01:10,426 DEBUG [Listener at localhost/45791] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59 2023-09-19 20:01:10,517 INFO [Listener at localhost/45791] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59/cluster_89d21045-e502-a291-a4eb-07ce7438eb28/zookeeper_0, clientPort=60323, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59/cluster_89d21045-e502-a291-a4eb-07ce7438eb28/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59/cluster_89d21045-e502-a291-a4eb-07ce7438eb28/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-09-19 20:01:10,535 INFO [Listener at localhost/45791] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=60323 2023-09-19 20:01:10,545 INFO [Listener at localhost/45791] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-19 20:01:10,548 INFO [Listener at localhost/45791] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-19 20:01:11,232 INFO [Listener at localhost/45791] util.FSUtils(471): Created version file at hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf with version=8 2023-09-19 20:01:11,232 INFO [Listener at localhost/45791] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/hbase-staging 2023-09-19 20:01:11,642 INFO [Listener at localhost/45791] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-09-19 20:01:12,106 INFO [Listener at localhost/45791] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-09-19 20:01:12,139 INFO [Listener at localhost/45791] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-19 20:01:12,139 INFO [Listener at localhost/45791] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-19 20:01:12,139 INFO [Listener at localhost/45791] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-19 20:01:12,139 INFO [Listener at localhost/45791] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-19 20:01:12,140 INFO [Listener at localhost/45791] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-19 20:01:12,282 INFO [Listener at localhost/45791] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-09-19 20:01:12,356 DEBUG [Listener at localhost/45791] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-09-19 20:01:12,448 INFO [Listener at localhost/45791] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37929 2023-09-19 20:01:12,461 INFO [Listener at localhost/45791] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-19 20:01:12,463 INFO [Listener at localhost/45791] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-19 20:01:12,486 INFO [Listener at localhost/45791] zookeeper.RecoverableZooKeeper(93): Process identifier=master:37929 connecting to ZooKeeper ensemble=127.0.0.1:60323 2023-09-19 20:01:12,551 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:379290x0, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-19 20:01:12,555 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:37929-0x100c5c781040000 connected 2023-09-19 20:01:12,593 DEBUG [Listener at localhost/45791] zookeeper.ZKUtil(164): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-19 20:01:12,594 DEBUG [Listener at localhost/45791] zookeeper.ZKUtil(164): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-19 20:01:12,608 DEBUG [Listener at localhost/45791] zookeeper.ZKUtil(164): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-19 20:01:12,617 DEBUG [Listener at localhost/45791] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37929 2023-09-19 20:01:12,618 DEBUG [Listener at localhost/45791] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37929 2023-09-19 20:01:12,618 DEBUG [Listener at localhost/45791] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37929 2023-09-19 20:01:12,619 DEBUG [Listener at localhost/45791] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37929 2023-09-19 20:01:12,620 DEBUG [Listener at localhost/45791] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37929 2023-09-19 20:01:12,626 INFO [Listener at localhost/45791] master.HMaster(444): hbase.rootdir=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf, hbase.cluster.distributed=false 2023-09-19 20:01:12,696 INFO [Listener at localhost/45791] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-19 20:01:12,696 INFO [Listener at localhost/45791] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-19 20:01:12,696 INFO [Listener at localhost/45791] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-19 20:01:12,696 INFO [Listener at localhost/45791] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-19 20:01:12,696 INFO [Listener at localhost/45791] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-19 20:01:12,697 INFO [Listener at localhost/45791] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-19 20:01:12,701 INFO [Listener at localhost/45791] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-19 20:01:12,704 INFO [Listener at localhost/45791] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45123 2023-09-19 20:01:12,707 INFO [Listener at localhost/45791] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-19 20:01:12,713 INFO [Listener at localhost/45791] mob.MobFileCache(124): MobFileCache disabled 2023-09-19 20:01:12,715 INFO [Listener at localhost/45791] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-19 20:01:12,716 INFO [Listener at localhost/45791] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-19 20:01:12,719 INFO [Listener at localhost/45791] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:45123 connecting to ZooKeeper ensemble=127.0.0.1:60323 2023-09-19 20:01:12,722 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:451230x0, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-19 20:01:12,723 DEBUG [Listener at localhost/45791] zookeeper.ZKUtil(164): regionserver:451230x0, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-19 20:01:12,724 DEBUG [Listener at localhost/45791] zookeeper.ZKUtil(164): regionserver:451230x0, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-19 20:01:12,725 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:45123-0x100c5c781040001 connected 2023-09-19 20:01:12,725 DEBUG [Listener at localhost/45791] zookeeper.ZKUtil(164): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-19 20:01:12,726 DEBUG [Listener at localhost/45791] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45123 2023-09-19 20:01:12,726 DEBUG [Listener at localhost/45791] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45123 2023-09-19 20:01:12,729 DEBUG [Listener at localhost/45791] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45123 2023-09-19 20:01:12,729 DEBUG [Listener at localhost/45791] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45123 2023-09-19 20:01:12,730 DEBUG [Listener at localhost/45791] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45123 2023-09-19 20:01:12,742 INFO [Listener at localhost/45791] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-19 20:01:12,743 INFO [Listener at localhost/45791] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-19 20:01:12,743 INFO [Listener at localhost/45791] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-19 20:01:12,743 INFO [Listener at localhost/45791] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-19 20:01:12,743 INFO [Listener at localhost/45791] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-19 20:01:12,744 INFO [Listener at localhost/45791] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-19 20:01:12,744 INFO [Listener at localhost/45791] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-19 20:01:12,745 INFO [Listener at localhost/45791] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40397 2023-09-19 20:01:12,746 INFO [Listener at localhost/45791] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-19 20:01:12,749 INFO [Listener at localhost/45791] mob.MobFileCache(124): MobFileCache disabled 2023-09-19 20:01:12,750 INFO [Listener at localhost/45791] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-19 20:01:12,752 INFO [Listener at localhost/45791] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-19 20:01:12,756 INFO [Listener at localhost/45791] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40397 connecting to ZooKeeper ensemble=127.0.0.1:60323 2023-09-19 20:01:12,761 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:403970x0, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-19 20:01:12,762 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:40397-0x100c5c781040002 connected 2023-09-19 20:01:12,762 DEBUG [Listener at localhost/45791] zookeeper.ZKUtil(164): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-19 20:01:12,763 DEBUG [Listener at localhost/45791] zookeeper.ZKUtil(164): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-19 20:01:12,764 DEBUG [Listener at localhost/45791] zookeeper.ZKUtil(164): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-19 20:01:12,765 DEBUG [Listener at localhost/45791] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40397 2023-09-19 20:01:12,765 DEBUG [Listener at localhost/45791] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40397 2023-09-19 20:01:12,765 DEBUG [Listener at localhost/45791] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40397 2023-09-19 20:01:12,773 DEBUG [Listener at localhost/45791] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40397 2023-09-19 20:01:12,773 DEBUG [Listener at localhost/45791] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40397 2023-09-19 20:01:12,785 INFO [Listener at localhost/45791] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-19 20:01:12,785 INFO [Listener at localhost/45791] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-19 20:01:12,785 INFO [Listener at localhost/45791] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-19 20:01:12,786 INFO [Listener at localhost/45791] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-19 20:01:12,786 INFO [Listener at localhost/45791] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-19 20:01:12,786 INFO [Listener at localhost/45791] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-19 20:01:12,786 INFO [Listener at localhost/45791] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-19 20:01:12,787 INFO [Listener at localhost/45791] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40839 2023-09-19 20:01:12,788 INFO [Listener at localhost/45791] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-19 20:01:12,789 INFO [Listener at localhost/45791] mob.MobFileCache(124): MobFileCache disabled 2023-09-19 20:01:12,790 INFO [Listener at localhost/45791] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-19 20:01:12,791 INFO [Listener at localhost/45791] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-19 20:01:12,793 INFO [Listener at localhost/45791] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40839 connecting to ZooKeeper ensemble=127.0.0.1:60323 2023-09-19 20:01:12,797 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:408390x0, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-19 20:01:12,798 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:40839-0x100c5c781040003 connected 2023-09-19 20:01:12,798 DEBUG [Listener at localhost/45791] zookeeper.ZKUtil(164): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-19 20:01:12,799 DEBUG [Listener at localhost/45791] zookeeper.ZKUtil(164): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-19 20:01:12,800 DEBUG [Listener at localhost/45791] zookeeper.ZKUtil(164): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-19 20:01:12,801 DEBUG [Listener at localhost/45791] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40839 2023-09-19 20:01:12,804 DEBUG [Listener at localhost/45791] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40839 2023-09-19 20:01:12,805 DEBUG [Listener at localhost/45791] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40839 2023-09-19 20:01:12,805 DEBUG [Listener at localhost/45791] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40839 2023-09-19 20:01:12,809 DEBUG [Listener at localhost/45791] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40839 2023-09-19 20:01:12,810 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,37929,1695153671462 2023-09-19 20:01:12,819 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-09-19 20:01:12,821 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,37929,1695153671462 2023-09-19 20:01:12,840 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-19 20:01:12,840 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-19 20:01:12,840 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-19 20:01:12,840 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-19 20:01:12,840 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-19 20:01:12,842 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-09-19 20:01:12,844 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,37929,1695153671462 from backup master directory 2023-09-19 20:01:12,844 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-09-19 20:01:12,848 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,37929,1695153671462 2023-09-19 20:01:12,848 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-09-19 20:01:12,849 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-19 20:01:12,849 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,37929,1695153671462 2023-09-19 20:01:12,852 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-09-19 20:01:12,854 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-09-19 20:01:12,949 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/hbase.id with ID: d3ce90a1-4497-4e37-91df-6e007451e533 2023-09-19 20:01:12,993 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-19 20:01:13,009 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-19 20:01:13,066 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x056403ec to 127.0.0.1:60323 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-19 20:01:13,101 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@53154b2a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-19 20:01:13,132 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-09-19 20:01:13,134 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-09-19 20:01:13,152 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-09-19 20:01:13,152 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-09-19 20:01:13,154 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-09-19 20:01:13,158 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-09-19 20:01:13,160 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-19 20:01:13,196 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/MasterData/data/master/store-tmp 2023-09-19 20:01:13,240 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 20:01:13,240 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-09-19 20:01:13,240 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-19 20:01:13,240 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-19 20:01:13,240 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-09-19 20:01:13,240 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-19 20:01:13,241 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-19 20:01:13,241 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-19 20:01:13,242 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/MasterData/WALs/jenkins-hbase4.apache.org,37929,1695153671462 2023-09-19 20:01:13,270 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37929%2C1695153671462, suffix=, logDir=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/MasterData/WALs/jenkins-hbase4.apache.org,37929,1695153671462, archiveDir=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/MasterData/oldWALs, maxLogs=10 2023-09-19 20:01:13,337 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34015,DS-d00bd8bd-0bea-4f74-a740-9320075799e8,DISK] 2023-09-19 20:01:13,337 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40747,DS-b8595a0b-04ed-453f-98c5-2357642c2198,DISK] 2023-09-19 20:01:13,337 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43319,DS-75546988-adb7-4d6b-a318-ee669a29a76e,DISK] 2023-09-19 20:01:13,347 DEBUG [RS-EventLoopGroup-5-3] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-09-19 20:01:13,415 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/MasterData/WALs/jenkins-hbase4.apache.org,37929,1695153671462/jenkins-hbase4.apache.org%2C37929%2C1695153671462.1695153673287 2023-09-19 20:01:13,416 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43319,DS-75546988-adb7-4d6b-a318-ee669a29a76e,DISK], DatanodeInfoWithStorage[127.0.0.1:40747,DS-b8595a0b-04ed-453f-98c5-2357642c2198,DISK], DatanodeInfoWithStorage[127.0.0.1:34015,DS-d00bd8bd-0bea-4f74-a740-9320075799e8,DISK]] 2023-09-19 20:01:13,417 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-09-19 20:01:13,417 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 20:01:13,421 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-09-19 20:01:13,423 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-09-19 20:01:13,488 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-09-19 20:01:13,495 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-09-19 20:01:13,524 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-09-19 20:01:13,538 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-19 20:01:13,545 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-09-19 20:01:13,547 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-09-19 20:01:13,563 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-09-19 20:01:13,567 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-19 20:01:13,568 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72479029, jitterRate=0.0800216943025589}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-19 20:01:13,568 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-19 20:01:13,569 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-09-19 20:01:13,592 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-09-19 20:01:13,592 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(561): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-09-19 20:01:13,595 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-09-19 20:01:13,597 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(581): Recovered RegionProcedureStore lease in 1 msec 2023-09-19 20:01:13,634 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(595): Loaded RegionProcedureStore in 36 msec 2023-09-19 20:01:13,634 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-09-19 20:01:13,664 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-09-19 20:01:13,671 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-09-19 20:01:13,703 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-09-19 20:01:13,711 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-09-19 20:01:13,712 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-09-19 20:01:13,719 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-09-19 20:01:13,723 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-09-19 20:01:13,726 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-19 20:01:13,727 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-09-19 20:01:13,728 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-09-19 20:01:13,745 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-09-19 20:01:13,750 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-19 20:01:13,750 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-19 20:01:13,750 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-19 20:01:13,750 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-19 20:01:13,750 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-19 20:01:13,751 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,37929,1695153671462, sessionid=0x100c5c781040000, setting cluster-up flag (Was=false) 2023-09-19 20:01:13,768 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-19 20:01:13,774 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-09-19 20:01:13,776 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,37929,1695153671462 2023-09-19 20:01:13,783 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-19 20:01:13,789 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-09-19 20:01:13,791 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,37929,1695153671462 2023-09-19 20:01:13,794 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/.tmp 2023-09-19 20:01:13,813 INFO [RS:0;jenkins-hbase4:45123] regionserver.HRegionServer(951): ClusterId : d3ce90a1-4497-4e37-91df-6e007451e533 2023-09-19 20:01:13,813 INFO [RS:2;jenkins-hbase4:40839] regionserver.HRegionServer(951): ClusterId : d3ce90a1-4497-4e37-91df-6e007451e533 2023-09-19 20:01:13,815 INFO [RS:1;jenkins-hbase4:40397] regionserver.HRegionServer(951): ClusterId : d3ce90a1-4497-4e37-91df-6e007451e533 2023-09-19 20:01:13,820 DEBUG [RS:2;jenkins-hbase4:40839] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-19 20:01:13,820 DEBUG [RS:0;jenkins-hbase4:45123] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-19 20:01:13,820 DEBUG [RS:1;jenkins-hbase4:40397] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-19 20:01:13,827 DEBUG [RS:0;jenkins-hbase4:45123] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-19 20:01:13,827 DEBUG [RS:1;jenkins-hbase4:40397] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-19 20:01:13,827 DEBUG [RS:2;jenkins-hbase4:40839] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-19 20:01:13,827 DEBUG [RS:1;jenkins-hbase4:40397] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-19 20:01:13,827 DEBUG [RS:0;jenkins-hbase4:45123] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-19 20:01:13,827 DEBUG [RS:2;jenkins-hbase4:40839] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-19 20:01:13,838 DEBUG [RS:2;jenkins-hbase4:40839] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-19 20:01:13,839 DEBUG [RS:0;jenkins-hbase4:45123] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-19 20:01:13,844 DEBUG [RS:1;jenkins-hbase4:40397] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-19 20:01:13,844 DEBUG [RS:2;jenkins-hbase4:40839] zookeeper.ReadOnlyZKClient(139): Connect 0x563f9214 to 127.0.0.1:60323 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-19 20:01:13,846 DEBUG [RS:0;jenkins-hbase4:45123] zookeeper.ReadOnlyZKClient(139): Connect 0x79a2bbc8 to 127.0.0.1:60323 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-19 20:01:13,848 DEBUG [RS:1;jenkins-hbase4:40397] zookeeper.ReadOnlyZKClient(139): Connect 0x55bf031d to 127.0.0.1:60323 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-19 20:01:13,854 DEBUG [RS:2;jenkins-hbase4:40839] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@58f866a3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-19 20:01:13,855 DEBUG [RS:2;jenkins-hbase4:40839] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5cc7f964, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-19 20:01:13,856 DEBUG [RS:0;jenkins-hbase4:45123] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@77654a8c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-19 20:01:13,856 DEBUG [RS:0;jenkins-hbase4:45123] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@735ad0b8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-19 20:01:13,885 DEBUG [RS:1;jenkins-hbase4:40397] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5b78e7da, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-19 20:01:13,886 DEBUG [RS:1;jenkins-hbase4:40397] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5f47686d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-19 20:01:13,911 DEBUG [RS:2;jenkins-hbase4:40839] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:40839 2023-09-19 20:01:13,911 DEBUG [RS:1;jenkins-hbase4:40397] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:40397 2023-09-19 20:01:13,912 DEBUG [RS:0;jenkins-hbase4:45123] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:45123 2023-09-19 20:01:13,919 INFO [RS:0;jenkins-hbase4:45123] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-19 20:01:13,919 INFO [RS:2;jenkins-hbase4:40839] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-19 20:01:13,919 INFO [RS:1;jenkins-hbase4:40397] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-19 20:01:13,919 INFO [RS:2;jenkins-hbase4:40839] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-19 20:01:13,919 INFO [RS:0;jenkins-hbase4:45123] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-19 20:01:13,919 INFO [RS:1;jenkins-hbase4:40397] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-19 20:01:13,948 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-09-19 20:01:13,948 DEBUG [RS:1;jenkins-hbase4:40397] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-19 20:01:13,948 DEBUG [RS:2;jenkins-hbase4:40839] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-19 20:01:13,948 DEBUG [RS:0;jenkins-hbase4:45123] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-19 20:01:13,949 INFO [RS:0;jenkins-hbase4:45123] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-19 20:01:13,950 INFO [RS:2;jenkins-hbase4:40839] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-19 20:01:13,950 DEBUG [RS:0;jenkins-hbase4:45123] regionserver.HRegionServer(1022): About to register with Master. 2023-09-19 20:01:13,950 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-19 20:01:13,950 INFO [RS:1;jenkins-hbase4:40397] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-19 20:01:13,951 DEBUG [RS:1;jenkins-hbase4:40397] regionserver.HRegionServer(1022): About to register with Master. 2023-09-19 20:01:13,950 DEBUG [RS:2;jenkins-hbase4:40839] regionserver.HRegionServer(1022): About to register with Master. 2023-09-19 20:01:13,951 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-09-19 20:01:13,953 INFO [RS:0;jenkins-hbase4:45123] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,37929,1695153671462 with isa=jenkins-hbase4.apache.org/172.31.14.131:45123, startcode=1695153672695 2023-09-19 20:01:13,953 INFO [RS:2;jenkins-hbase4:40839] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,37929,1695153671462 with isa=jenkins-hbase4.apache.org/172.31.14.131:40839, startcode=1695153672784 2023-09-19 20:01:13,953 INFO [RS:1;jenkins-hbase4:40397] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,37929,1695153671462 with isa=jenkins-hbase4.apache.org/172.31.14.131:40397, startcode=1695153672742 2023-09-19 20:01:13,973 DEBUG [RS:2;jenkins-hbase4:40839] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-19 20:01:13,973 DEBUG [RS:1;jenkins-hbase4:40397] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-19 20:01:13,973 DEBUG [RS:0;jenkins-hbase4:45123] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-19 20:01:14,039 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46383, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-09-19 20:01:14,039 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43601, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-09-19 20:01:14,039 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53921, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-09-19 20:01:14,047 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-09-19 20:01:14,047 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37929] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-19 20:01:14,056 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37929] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-19 20:01:14,058 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37929] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-19 20:01:14,060 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-19 20:01:14,060 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-19 20:01:14,061 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-19 20:01:14,061 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-19 20:01:14,061 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-09-19 20:01:14,061 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-19 20:01:14,061 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-19 20:01:14,061 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-19 20:01:14,064 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1695153704064 2023-09-19 20:01:14,067 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-09-19 20:01:14,071 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-09-19 20:01:14,072 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-09-19 20:01:14,076 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-19 20:01:14,077 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-09-19 20:01:14,082 DEBUG [RS:1;jenkins-hbase4:40397] regionserver.HRegionServer(2830): Master is not running yet 2023-09-19 20:01:14,082 DEBUG [RS:0;jenkins-hbase4:45123] regionserver.HRegionServer(2830): Master is not running yet 2023-09-19 20:01:14,082 WARN [RS:1;jenkins-hbase4:40397] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-19 20:01:14,082 DEBUG [RS:2;jenkins-hbase4:40839] regionserver.HRegionServer(2830): Master is not running yet 2023-09-19 20:01:14,082 WARN [RS:0;jenkins-hbase4:45123] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-19 20:01:14,083 WARN [RS:2;jenkins-hbase4:40839] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-19 20:01:14,087 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-09-19 20:01:14,087 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-09-19 20:01:14,088 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-09-19 20:01:14,088 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-09-19 20:01:14,088 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-09-19 20:01:14,089 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-09-19 20:01:14,091 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-09-19 20:01:14,091 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-09-19 20:01:14,094 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-09-19 20:01:14,095 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-09-19 20:01:14,097 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1695153674097,5,FailOnTimeoutGroup] 2023-09-19 20:01:14,098 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1695153674097,5,FailOnTimeoutGroup] 2023-09-19 20:01:14,098 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-09-19 20:01:14,098 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-09-19 20:01:14,099 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-09-19 20:01:14,100 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-09-19 20:01:14,116 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-09-19 20:01:14,118 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-09-19 20:01:14,118 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf 2023-09-19 20:01:14,145 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 20:01:14,147 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-09-19 20:01:14,150 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/hbase/meta/1588230740/info 2023-09-19 20:01:14,151 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-09-19 20:01:14,152 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-19 20:01:14,152 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-09-19 20:01:14,155 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/hbase/meta/1588230740/rep_barrier 2023-09-19 20:01:14,155 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-09-19 20:01:14,156 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-19 20:01:14,156 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-09-19 20:01:14,158 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/hbase/meta/1588230740/table 2023-09-19 20:01:14,159 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-09-19 20:01:14,160 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-19 20:01:14,161 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/hbase/meta/1588230740 2023-09-19 20:01:14,162 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/hbase/meta/1588230740 2023-09-19 20:01:14,166 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-09-19 20:01:14,168 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-09-19 20:01:14,172 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-19 20:01:14,173 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59404965, jitterRate=-0.11479704082012177}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-09-19 20:01:14,173 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-09-19 20:01:14,173 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-09-19 20:01:14,173 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-09-19 20:01:14,173 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-09-19 20:01:14,173 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-09-19 20:01:14,173 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-09-19 20:01:14,175 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-09-19 20:01:14,175 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-09-19 20:01:14,180 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-09-19 20:01:14,180 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-09-19 20:01:14,183 INFO [RS:1;jenkins-hbase4:40397] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,37929,1695153671462 with isa=jenkins-hbase4.apache.org/172.31.14.131:40397, startcode=1695153672742 2023-09-19 20:01:14,184 INFO [RS:2;jenkins-hbase4:40839] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,37929,1695153671462 with isa=jenkins-hbase4.apache.org/172.31.14.131:40839, startcode=1695153672784 2023-09-19 20:01:14,184 INFO [RS:0;jenkins-hbase4:45123] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,37929,1695153671462 with isa=jenkins-hbase4.apache.org/172.31.14.131:45123, startcode=1695153672695 2023-09-19 20:01:14,190 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37929] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:14,192 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-09-19 20:01:14,196 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37929] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:14,197 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37929] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:14,197 DEBUG [RS:1;jenkins-hbase4:40397] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf 2023-09-19 20:01:14,198 DEBUG [RS:1;jenkins-hbase4:40397] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:38739 2023-09-19 20:01:14,198 DEBUG [RS:1;jenkins-hbase4:40397] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-19 20:01:14,198 DEBUG [RS:2;jenkins-hbase4:40839] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf 2023-09-19 20:01:14,198 DEBUG [RS:2;jenkins-hbase4:40839] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:38739 2023-09-19 20:01:14,198 DEBUG [RS:2;jenkins-hbase4:40839] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-19 20:01:14,200 DEBUG [RS:0;jenkins-hbase4:45123] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf 2023-09-19 20:01:14,200 DEBUG [RS:0;jenkins-hbase4:45123] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:38739 2023-09-19 20:01:14,200 DEBUG [RS:0;jenkins-hbase4:45123] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-19 20:01:14,210 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-19 20:01:14,211 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-09-19 20:01:14,211 DEBUG [RS:2;jenkins-hbase4:40839] zookeeper.ZKUtil(162): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:14,211 DEBUG [RS:0;jenkins-hbase4:45123] zookeeper.ZKUtil(162): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:14,212 WARN [RS:0;jenkins-hbase4:45123] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-19 20:01:14,212 INFO [RS:0;jenkins-hbase4:45123] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-19 20:01:14,212 DEBUG [RS:0;jenkins-hbase4:45123] regionserver.HRegionServer(1948): logDir=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/WALs/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:14,213 WARN [RS:2;jenkins-hbase4:40839] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-19 20:01:14,214 INFO [RS:2;jenkins-hbase4:40839] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-19 20:01:14,214 DEBUG [RS:1;jenkins-hbase4:40397] zookeeper.ZKUtil(162): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:14,214 DEBUG [RS:2;jenkins-hbase4:40839] regionserver.HRegionServer(1948): logDir=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/WALs/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:14,214 WARN [RS:1;jenkins-hbase4:40397] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-19 20:01:14,215 INFO [RS:1;jenkins-hbase4:40397] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-19 20:01:14,215 DEBUG [RS:1;jenkins-hbase4:40397] regionserver.HRegionServer(1948): logDir=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/WALs/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:14,215 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,45123,1695153672695] 2023-09-19 20:01:14,215 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,40839,1695153672784] 2023-09-19 20:01:14,215 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,40397,1695153672742] 2023-09-19 20:01:14,220 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-09-19 20:01:14,230 DEBUG [RS:2;jenkins-hbase4:40839] zookeeper.ZKUtil(162): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:14,230 DEBUG [RS:1;jenkins-hbase4:40397] zookeeper.ZKUtil(162): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:14,230 DEBUG [RS:0;jenkins-hbase4:45123] zookeeper.ZKUtil(162): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:14,231 DEBUG [RS:2;jenkins-hbase4:40839] zookeeper.ZKUtil(162): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:14,231 DEBUG [RS:1;jenkins-hbase4:40397] zookeeper.ZKUtil(162): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:14,231 DEBUG [RS:0;jenkins-hbase4:45123] zookeeper.ZKUtil(162): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:14,231 DEBUG [RS:2;jenkins-hbase4:40839] zookeeper.ZKUtil(162): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:14,231 DEBUG [RS:1;jenkins-hbase4:40397] zookeeper.ZKUtil(162): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:14,231 DEBUG [RS:0;jenkins-hbase4:45123] zookeeper.ZKUtil(162): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:14,244 DEBUG [RS:0;jenkins-hbase4:45123] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-19 20:01:14,244 DEBUG [RS:1;jenkins-hbase4:40397] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-19 20:01:14,244 DEBUG [RS:2;jenkins-hbase4:40839] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-19 20:01:14,254 INFO [RS:0;jenkins-hbase4:45123] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-19 20:01:14,254 INFO [RS:1;jenkins-hbase4:40397] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-19 20:01:14,254 INFO [RS:2;jenkins-hbase4:40839] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-19 20:01:14,281 INFO [RS:2;jenkins-hbase4:40839] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-19 20:01:14,281 INFO [RS:1;jenkins-hbase4:40397] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-19 20:01:14,281 INFO [RS:0;jenkins-hbase4:45123] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-19 20:01:14,286 INFO [RS:0;jenkins-hbase4:45123] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-19 20:01:14,286 INFO [RS:1;jenkins-hbase4:40397] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-19 20:01:14,286 INFO [RS:2;jenkins-hbase4:40839] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-19 20:01:14,287 INFO [RS:1;jenkins-hbase4:40397] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-19 20:01:14,287 INFO [RS:0;jenkins-hbase4:45123] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-19 20:01:14,287 INFO [RS:2;jenkins-hbase4:40839] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-19 20:01:14,289 INFO [RS:1;jenkins-hbase4:40397] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-19 20:01:14,289 INFO [RS:0;jenkins-hbase4:45123] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-19 20:01:14,289 INFO [RS:2;jenkins-hbase4:40839] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-19 20:01:14,297 INFO [RS:0;jenkins-hbase4:45123] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-19 20:01:14,297 INFO [RS:2;jenkins-hbase4:40839] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-19 20:01:14,297 INFO [RS:1;jenkins-hbase4:40397] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-19 20:01:14,298 DEBUG [RS:0;jenkins-hbase4:45123] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-19 20:01:14,298 DEBUG [RS:2;jenkins-hbase4:40839] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-19 20:01:14,298 DEBUG [RS:0;jenkins-hbase4:45123] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-19 20:01:14,298 DEBUG [RS:2;jenkins-hbase4:40839] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-19 20:01:14,298 DEBUG [RS:1;jenkins-hbase4:40397] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-19 20:01:14,298 DEBUG [RS:2;jenkins-hbase4:40839] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-19 20:01:14,299 DEBUG [RS:1;jenkins-hbase4:40397] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-19 20:01:14,299 DEBUG [RS:2;jenkins-hbase4:40839] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-19 20:01:14,299 DEBUG [RS:1;jenkins-hbase4:40397] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-19 20:01:14,299 DEBUG [RS:2;jenkins-hbase4:40839] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-19 20:01:14,299 DEBUG [RS:1;jenkins-hbase4:40397] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-19 20:01:14,298 DEBUG [RS:0;jenkins-hbase4:45123] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-19 20:01:14,299 DEBUG [RS:1;jenkins-hbase4:40397] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-19 20:01:14,299 DEBUG [RS:0;jenkins-hbase4:45123] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-19 20:01:14,299 DEBUG [RS:1;jenkins-hbase4:40397] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-19 20:01:14,299 DEBUG [RS:0;jenkins-hbase4:45123] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-19 20:01:14,299 DEBUG [RS:1;jenkins-hbase4:40397] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-19 20:01:14,299 DEBUG [RS:0;jenkins-hbase4:45123] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-19 20:01:14,299 DEBUG [RS:2;jenkins-hbase4:40839] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-19 20:01:14,299 DEBUG [RS:0;jenkins-hbase4:45123] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-19 20:01:14,299 DEBUG [RS:1;jenkins-hbase4:40397] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-19 20:01:14,299 DEBUG [RS:0;jenkins-hbase4:45123] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-19 20:01:14,299 DEBUG [RS:1;jenkins-hbase4:40397] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-19 20:01:14,299 DEBUG [RS:0;jenkins-hbase4:45123] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-19 20:01:14,300 DEBUG [RS:1;jenkins-hbase4:40397] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-19 20:01:14,300 DEBUG [RS:0;jenkins-hbase4:45123] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-19 20:01:14,299 DEBUG [RS:2;jenkins-hbase4:40839] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-19 20:01:14,300 DEBUG [RS:2;jenkins-hbase4:40839] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-19 20:01:14,301 DEBUG [RS:2;jenkins-hbase4:40839] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-19 20:01:14,301 DEBUG [RS:2;jenkins-hbase4:40839] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-19 20:01:14,301 INFO [RS:0;jenkins-hbase4:45123] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-19 20:01:14,302 INFO [RS:1;jenkins-hbase4:40397] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-19 20:01:14,302 INFO [RS:2;jenkins-hbase4:40839] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-19 20:01:14,302 INFO [RS:1;jenkins-hbase4:40397] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-19 20:01:14,302 INFO [RS:0;jenkins-hbase4:45123] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-19 20:01:14,302 INFO [RS:1;jenkins-hbase4:40397] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-19 20:01:14,302 INFO [RS:2;jenkins-hbase4:40839] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-19 20:01:14,302 INFO [RS:0;jenkins-hbase4:45123] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-19 20:01:14,302 INFO [RS:2;jenkins-hbase4:40839] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-19 20:01:14,327 INFO [RS:2;jenkins-hbase4:40839] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-19 20:01:14,327 INFO [RS:1;jenkins-hbase4:40397] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-19 20:01:14,327 INFO [RS:0;jenkins-hbase4:45123] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-19 20:01:14,332 INFO [RS:2;jenkins-hbase4:40839] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40839,1695153672784-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-19 20:01:14,332 INFO [RS:0;jenkins-hbase4:45123] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45123,1695153672695-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-19 20:01:14,332 INFO [RS:1;jenkins-hbase4:40397] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40397,1695153672742-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-19 20:01:14,357 INFO [RS:2;jenkins-hbase4:40839] regionserver.Replication(203): jenkins-hbase4.apache.org,40839,1695153672784 started 2023-09-19 20:01:14,357 INFO [RS:2;jenkins-hbase4:40839] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,40839,1695153672784, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:40839, sessionid=0x100c5c781040003 2023-09-19 20:01:14,361 INFO [RS:0;jenkins-hbase4:45123] regionserver.Replication(203): jenkins-hbase4.apache.org,45123,1695153672695 started 2023-09-19 20:01:14,361 INFO [RS:1;jenkins-hbase4:40397] regionserver.Replication(203): jenkins-hbase4.apache.org,40397,1695153672742 started 2023-09-19 20:01:14,361 DEBUG [RS:2;jenkins-hbase4:40839] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-19 20:01:14,361 INFO [RS:0;jenkins-hbase4:45123] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,45123,1695153672695, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:45123, sessionid=0x100c5c781040001 2023-09-19 20:01:14,361 DEBUG [RS:2;jenkins-hbase4:40839] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:14,361 DEBUG [RS:0;jenkins-hbase4:45123] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-19 20:01:14,361 DEBUG [RS:2;jenkins-hbase4:40839] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40839,1695153672784' 2023-09-19 20:01:14,361 DEBUG [RS:0;jenkins-hbase4:45123] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:14,361 INFO [RS:1;jenkins-hbase4:40397] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,40397,1695153672742, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:40397, sessionid=0x100c5c781040002 2023-09-19 20:01:14,362 DEBUG [RS:0;jenkins-hbase4:45123] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45123,1695153672695' 2023-09-19 20:01:14,363 DEBUG [RS:0;jenkins-hbase4:45123] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-19 20:01:14,362 DEBUG [RS:2;jenkins-hbase4:40839] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-19 20:01:14,363 DEBUG [RS:1;jenkins-hbase4:40397] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-19 20:01:14,364 DEBUG [RS:1;jenkins-hbase4:40397] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:14,364 DEBUG [RS:2;jenkins-hbase4:40839] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-19 20:01:14,364 DEBUG [RS:1;jenkins-hbase4:40397] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40397,1695153672742' 2023-09-19 20:01:14,364 DEBUG [RS:0;jenkins-hbase4:45123] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-19 20:01:14,364 DEBUG [RS:1;jenkins-hbase4:40397] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-19 20:01:14,365 DEBUG [RS:2;jenkins-hbase4:40839] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-19 20:01:14,365 DEBUG [RS:2;jenkins-hbase4:40839] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-19 20:01:14,365 DEBUG [RS:2;jenkins-hbase4:40839] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:14,365 DEBUG [RS:0;jenkins-hbase4:45123] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-19 20:01:14,365 DEBUG [RS:2;jenkins-hbase4:40839] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40839,1695153672784' 2023-09-19 20:01:14,365 DEBUG [RS:1;jenkins-hbase4:40397] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-19 20:01:14,365 DEBUG [RS:0;jenkins-hbase4:45123] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-19 20:01:14,365 DEBUG [RS:2;jenkins-hbase4:40839] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 20:01:14,365 DEBUG [RS:0;jenkins-hbase4:45123] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:14,367 DEBUG [RS:0;jenkins-hbase4:45123] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45123,1695153672695' 2023-09-19 20:01:14,367 DEBUG [RS:0;jenkins-hbase4:45123] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 20:01:14,367 DEBUG [RS:1;jenkins-hbase4:40397] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-19 20:01:14,367 DEBUG [RS:1;jenkins-hbase4:40397] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-19 20:01:14,367 DEBUG [RS:1;jenkins-hbase4:40397] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:14,368 DEBUG [RS:1;jenkins-hbase4:40397] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40397,1695153672742' 2023-09-19 20:01:14,368 DEBUG [RS:1;jenkins-hbase4:40397] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 20:01:14,367 DEBUG [RS:2;jenkins-hbase4:40839] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 20:01:14,368 DEBUG [RS:2;jenkins-hbase4:40839] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-19 20:01:14,368 INFO [RS:2;jenkins-hbase4:40839] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-19 20:01:14,369 INFO [RS:2;jenkins-hbase4:40839] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-19 20:01:14,369 DEBUG [RS:1;jenkins-hbase4:40397] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 20:01:14,369 DEBUG [RS:1;jenkins-hbase4:40397] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-19 20:01:14,370 INFO [RS:1;jenkins-hbase4:40397] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-19 20:01:14,370 INFO [RS:1;jenkins-hbase4:40397] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-19 20:01:14,370 DEBUG [RS:0;jenkins-hbase4:45123] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 20:01:14,371 DEBUG [RS:0;jenkins-hbase4:45123] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-19 20:01:14,371 INFO [RS:0;jenkins-hbase4:45123] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-19 20:01:14,371 INFO [RS:0;jenkins-hbase4:45123] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-19 20:01:14,372 DEBUG [jenkins-hbase4:37929] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-09-19 20:01:14,376 DEBUG [jenkins-hbase4:37929] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-19 20:01:14,382 DEBUG [jenkins-hbase4:37929] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-19 20:01:14,382 DEBUG [jenkins-hbase4:37929] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-19 20:01:14,382 DEBUG [jenkins-hbase4:37929] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-19 20:01:14,383 DEBUG [jenkins-hbase4:37929] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-19 20:01:14,385 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,45123,1695153672695, state=OPENING 2023-09-19 20:01:14,393 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-09-19 20:01:14,394 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-19 20:01:14,395 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-09-19 20:01:14,399 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,45123,1695153672695}] 2023-09-19 20:01:14,481 INFO [RS:0;jenkins-hbase4:45123] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45123%2C1695153672695, suffix=, logDir=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/WALs/jenkins-hbase4.apache.org,45123,1695153672695, archiveDir=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/oldWALs, maxLogs=32 2023-09-19 20:01:14,481 INFO [RS:1;jenkins-hbase4:40397] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40397%2C1695153672742, suffix=, logDir=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/WALs/jenkins-hbase4.apache.org,40397,1695153672742, archiveDir=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/oldWALs, maxLogs=32 2023-09-19 20:01:14,481 INFO [RS:2;jenkins-hbase4:40839] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40839%2C1695153672784, suffix=, logDir=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/WALs/jenkins-hbase4.apache.org,40839,1695153672784, archiveDir=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/oldWALs, maxLogs=32 2023-09-19 20:01:14,511 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34015,DS-d00bd8bd-0bea-4f74-a740-9320075799e8,DISK] 2023-09-19 20:01:14,511 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43319,DS-75546988-adb7-4d6b-a318-ee669a29a76e,DISK] 2023-09-19 20:01:14,511 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40747,DS-b8595a0b-04ed-453f-98c5-2357642c2198,DISK] 2023-09-19 20:01:14,512 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40747,DS-b8595a0b-04ed-453f-98c5-2357642c2198,DISK] 2023-09-19 20:01:14,512 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43319,DS-75546988-adb7-4d6b-a318-ee669a29a76e,DISK] 2023-09-19 20:01:14,512 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34015,DS-d00bd8bd-0bea-4f74-a740-9320075799e8,DISK] 2023-09-19 20:01:14,521 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34015,DS-d00bd8bd-0bea-4f74-a740-9320075799e8,DISK] 2023-09-19 20:01:14,521 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40747,DS-b8595a0b-04ed-453f-98c5-2357642c2198,DISK] 2023-09-19 20:01:14,521 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43319,DS-75546988-adb7-4d6b-a318-ee669a29a76e,DISK] 2023-09-19 20:01:14,532 INFO [RS:0;jenkins-hbase4:45123] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/WALs/jenkins-hbase4.apache.org,45123,1695153672695/jenkins-hbase4.apache.org%2C45123%2C1695153672695.1695153674486 2023-09-19 20:01:14,533 INFO [RS:1;jenkins-hbase4:40397] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/WALs/jenkins-hbase4.apache.org,40397,1695153672742/jenkins-hbase4.apache.org%2C40397%2C1695153672742.1695153674486 2023-09-19 20:01:14,533 DEBUG [RS:0;jenkins-hbase4:45123] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40747,DS-b8595a0b-04ed-453f-98c5-2357642c2198,DISK], DatanodeInfoWithStorage[127.0.0.1:34015,DS-d00bd8bd-0bea-4f74-a740-9320075799e8,DISK], DatanodeInfoWithStorage[127.0.0.1:43319,DS-75546988-adb7-4d6b-a318-ee669a29a76e,DISK]] 2023-09-19 20:01:14,533 INFO [RS:2;jenkins-hbase4:40839] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/WALs/jenkins-hbase4.apache.org,40839,1695153672784/jenkins-hbase4.apache.org%2C40839%2C1695153672784.1695153674486 2023-09-19 20:01:14,537 DEBUG [RS:1;jenkins-hbase4:40397] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43319,DS-75546988-adb7-4d6b-a318-ee669a29a76e,DISK], DatanodeInfoWithStorage[127.0.0.1:40747,DS-b8595a0b-04ed-453f-98c5-2357642c2198,DISK], DatanodeInfoWithStorage[127.0.0.1:34015,DS-d00bd8bd-0bea-4f74-a740-9320075799e8,DISK]] 2023-09-19 20:01:14,537 DEBUG [RS:2;jenkins-hbase4:40839] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40747,DS-b8595a0b-04ed-453f-98c5-2357642c2198,DISK], DatanodeInfoWithStorage[127.0.0.1:34015,DS-d00bd8bd-0bea-4f74-a740-9320075799e8,DISK], DatanodeInfoWithStorage[127.0.0.1:43319,DS-75546988-adb7-4d6b-a318-ee669a29a76e,DISK]] 2023-09-19 20:01:14,584 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:14,586 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-19 20:01:14,590 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48186, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-19 20:01:14,603 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-09-19 20:01:14,604 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-19 20:01:14,608 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45123%2C1695153672695.meta, suffix=.meta, logDir=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/WALs/jenkins-hbase4.apache.org,45123,1695153672695, archiveDir=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/oldWALs, maxLogs=32 2023-09-19 20:01:14,627 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43319,DS-75546988-adb7-4d6b-a318-ee669a29a76e,DISK] 2023-09-19 20:01:14,629 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34015,DS-d00bd8bd-0bea-4f74-a740-9320075799e8,DISK] 2023-09-19 20:01:14,630 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40747,DS-b8595a0b-04ed-453f-98c5-2357642c2198,DISK] 2023-09-19 20:01:14,638 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/WALs/jenkins-hbase4.apache.org,45123,1695153672695/jenkins-hbase4.apache.org%2C45123%2C1695153672695.meta.1695153674609.meta 2023-09-19 20:01:14,639 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43319,DS-75546988-adb7-4d6b-a318-ee669a29a76e,DISK], DatanodeInfoWithStorage[127.0.0.1:34015,DS-d00bd8bd-0bea-4f74-a740-9320075799e8,DISK], DatanodeInfoWithStorage[127.0.0.1:40747,DS-b8595a0b-04ed-453f-98c5-2357642c2198,DISK]] 2023-09-19 20:01:14,640 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-09-19 20:01:14,641 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-09-19 20:01:14,643 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-19 20:01:14,644 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-09-19 20:01:14,647 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-09-19 20:01:14,648 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-09-19 20:01:14,666 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-09-19 20:01:14,666 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 20:01:14,667 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-09-19 20:01:14,667 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-09-19 20:01:14,670 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-09-19 20:01:14,672 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/hbase/meta/1588230740/info 2023-09-19 20:01:14,672 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/hbase/meta/1588230740/info 2023-09-19 20:01:14,673 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-09-19 20:01:14,673 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-19 20:01:14,674 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-09-19 20:01:14,675 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/hbase/meta/1588230740/rep_barrier 2023-09-19 20:01:14,675 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/hbase/meta/1588230740/rep_barrier 2023-09-19 20:01:14,676 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-09-19 20:01:14,677 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-19 20:01:14,677 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-09-19 20:01:14,678 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/hbase/meta/1588230740/table 2023-09-19 20:01:14,678 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/hbase/meta/1588230740/table 2023-09-19 20:01:14,679 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-09-19 20:01:14,680 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-19 20:01:14,682 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/hbase/meta/1588230740 2023-09-19 20:01:14,685 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/hbase/meta/1588230740 2023-09-19 20:01:14,689 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-09-19 20:01:14,691 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-09-19 20:01:14,693 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62464026, jitterRate=-0.06921347975730896}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-09-19 20:01:14,695 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-09-19 20:01:14,706 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1695153674575 2023-09-19 20:01:14,727 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-09-19 20:01:14,729 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-09-19 20:01:14,729 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,45123,1695153672695, state=OPEN 2023-09-19 20:01:14,733 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-09-19 20:01:14,733 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-09-19 20:01:14,740 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=3, resume processing ppid=2 2023-09-19 20:01:14,740 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,45123,1695153672695 in 334 msec 2023-09-19 20:01:14,747 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=2, resume processing ppid=1 2023-09-19 20:01:14,747 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 549 msec 2023-09-19 20:01:14,753 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 792 msec 2023-09-19 20:01:14,753 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1695153674753, completionTime=-1 2023-09-19 20:01:14,753 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-09-19 20:01:14,753 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-09-19 20:01:14,838 DEBUG [hconnection-0x51b5961f-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 20:01:14,842 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48198, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 20:01:14,865 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-09-19 20:01:14,865 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1695153734865 2023-09-19 20:01:14,865 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1695153794865 2023-09-19 20:01:14,865 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 111 msec 2023-09-19 20:01:14,929 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37929,1695153671462-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-19 20:01:14,930 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37929,1695153671462-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-09-19 20:01:14,930 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37929,1695153671462-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-09-19 20:01:14,932 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:37929, period=300000, unit=MILLISECONDS is enabled. 2023-09-19 20:01:14,932 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-09-19 20:01:14,941 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-09-19 20:01:14,948 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-09-19 20:01:14,949 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-19 20:01:14,959 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-09-19 20:01:14,962 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-09-19 20:01:14,965 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-19 20:01:14,990 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/hbase/namespace/5cf9e8f3ef3edde93a47c370d861e6b1 2023-09-19 20:01:14,993 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/hbase/namespace/5cf9e8f3ef3edde93a47c370d861e6b1 empty. 2023-09-19 20:01:14,993 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/hbase/namespace/5cf9e8f3ef3edde93a47c370d861e6b1 2023-09-19 20:01:14,994 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-09-19 20:01:15,033 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-09-19 20:01:15,035 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 5cf9e8f3ef3edde93a47c370d861e6b1, NAME => 'hbase:namespace,,1695153674949.5cf9e8f3ef3edde93a47c370d861e6b1.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp 2023-09-19 20:01:15,055 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1695153674949.5cf9e8f3ef3edde93a47c370d861e6b1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 20:01:15,055 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 5cf9e8f3ef3edde93a47c370d861e6b1, disabling compactions & flushes 2023-09-19 20:01:15,055 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1695153674949.5cf9e8f3ef3edde93a47c370d861e6b1. 2023-09-19 20:01:15,055 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1695153674949.5cf9e8f3ef3edde93a47c370d861e6b1. 2023-09-19 20:01:15,055 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1695153674949.5cf9e8f3ef3edde93a47c370d861e6b1. after waiting 0 ms 2023-09-19 20:01:15,055 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1695153674949.5cf9e8f3ef3edde93a47c370d861e6b1. 2023-09-19 20:01:15,055 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1695153674949.5cf9e8f3ef3edde93a47c370d861e6b1. 2023-09-19 20:01:15,055 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 5cf9e8f3ef3edde93a47c370d861e6b1: 2023-09-19 20:01:15,060 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-09-19 20:01:15,078 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1695153674949.5cf9e8f3ef3edde93a47c370d861e6b1.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1695153675064"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695153675064"}]},"ts":"1695153675064"} 2023-09-19 20:01:15,109 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-09-19 20:01:15,111 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-19 20:01:15,116 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695153675111"}]},"ts":"1695153675111"} 2023-09-19 20:01:15,121 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-09-19 20:01:15,126 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-19 20:01:15,127 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-19 20:01:15,127 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-19 20:01:15,127 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-19 20:01:15,127 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-19 20:01:15,134 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=5cf9e8f3ef3edde93a47c370d861e6b1, ASSIGN}] 2023-09-19 20:01:15,138 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=5cf9e8f3ef3edde93a47c370d861e6b1, ASSIGN 2023-09-19 20:01:15,141 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=5cf9e8f3ef3edde93a47c370d861e6b1, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40397,1695153672742; forceNewPlan=false, retain=false 2023-09-19 20:01:15,293 INFO [jenkins-hbase4:37929] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-19 20:01:15,294 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=5cf9e8f3ef3edde93a47c370d861e6b1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:15,294 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1695153674949.5cf9e8f3ef3edde93a47c370d861e6b1.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1695153675294"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695153675294"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695153675294"}]},"ts":"1695153675294"} 2023-09-19 20:01:15,299 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 5cf9e8f3ef3edde93a47c370d861e6b1, server=jenkins-hbase4.apache.org,40397,1695153672742}] 2023-09-19 20:01:15,454 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:15,455 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-19 20:01:15,458 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52132, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-19 20:01:15,464 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1695153674949.5cf9e8f3ef3edde93a47c370d861e6b1. 2023-09-19 20:01:15,464 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5cf9e8f3ef3edde93a47c370d861e6b1, NAME => 'hbase:namespace,,1695153674949.5cf9e8f3ef3edde93a47c370d861e6b1.', STARTKEY => '', ENDKEY => ''} 2023-09-19 20:01:15,465 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1695153674949.5cf9e8f3ef3edde93a47c370d861e6b1. service=AccessControlService 2023-09-19 20:01:15,466 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-19 20:01:15,466 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 5cf9e8f3ef3edde93a47c370d861e6b1 2023-09-19 20:01:15,466 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1695153674949.5cf9e8f3ef3edde93a47c370d861e6b1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 20:01:15,466 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5cf9e8f3ef3edde93a47c370d861e6b1 2023-09-19 20:01:15,466 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5cf9e8f3ef3edde93a47c370d861e6b1 2023-09-19 20:01:15,469 INFO [StoreOpener-5cf9e8f3ef3edde93a47c370d861e6b1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 5cf9e8f3ef3edde93a47c370d861e6b1 2023-09-19 20:01:15,471 DEBUG [StoreOpener-5cf9e8f3ef3edde93a47c370d861e6b1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/hbase/namespace/5cf9e8f3ef3edde93a47c370d861e6b1/info 2023-09-19 20:01:15,472 DEBUG [StoreOpener-5cf9e8f3ef3edde93a47c370d861e6b1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/hbase/namespace/5cf9e8f3ef3edde93a47c370d861e6b1/info 2023-09-19 20:01:15,472 INFO [StoreOpener-5cf9e8f3ef3edde93a47c370d861e6b1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5cf9e8f3ef3edde93a47c370d861e6b1 columnFamilyName info 2023-09-19 20:01:15,473 INFO [StoreOpener-5cf9e8f3ef3edde93a47c370d861e6b1-1] regionserver.HStore(310): Store=5cf9e8f3ef3edde93a47c370d861e6b1/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-19 20:01:15,475 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/hbase/namespace/5cf9e8f3ef3edde93a47c370d861e6b1 2023-09-19 20:01:15,476 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/hbase/namespace/5cf9e8f3ef3edde93a47c370d861e6b1 2023-09-19 20:01:15,480 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5cf9e8f3ef3edde93a47c370d861e6b1 2023-09-19 20:01:15,484 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/hbase/namespace/5cf9e8f3ef3edde93a47c370d861e6b1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-19 20:01:15,485 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5cf9e8f3ef3edde93a47c370d861e6b1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68241985, jitterRate=0.01688481867313385}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-19 20:01:15,485 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5cf9e8f3ef3edde93a47c370d861e6b1: 2023-09-19 20:01:15,487 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1695153674949.5cf9e8f3ef3edde93a47c370d861e6b1., pid=6, masterSystemTime=1695153675454 2023-09-19 20:01:15,493 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1695153674949.5cf9e8f3ef3edde93a47c370d861e6b1. 2023-09-19 20:01:15,493 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1695153674949.5cf9e8f3ef3edde93a47c370d861e6b1. 2023-09-19 20:01:15,495 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=5cf9e8f3ef3edde93a47c370d861e6b1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:15,495 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1695153674949.5cf9e8f3ef3edde93a47c370d861e6b1.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1695153675494"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695153675494"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695153675494"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695153675494"}]},"ts":"1695153675494"} 2023-09-19 20:01:15,503 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=6, resume processing ppid=5 2023-09-19 20:01:15,503 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 5cf9e8f3ef3edde93a47c370d861e6b1, server=jenkins-hbase4.apache.org,40397,1695153672742 in 200 msec 2023-09-19 20:01:15,507 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=5, resume processing ppid=4 2023-09-19 20:01:15,508 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=5cf9e8f3ef3edde93a47c370d861e6b1, ASSIGN in 369 msec 2023-09-19 20:01:15,509 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-19 20:01:15,509 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695153675509"}]},"ts":"1695153675509"} 2023-09-19 20:01:15,512 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-09-19 20:01:15,515 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-09-19 20:01:15,518 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 565 msec 2023-09-19 20:01:15,562 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-09-19 20:01:15,563 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-09-19 20:01:15,563 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-19 20:01:15,587 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 20:01:15,590 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52136, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 20:01:15,603 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-09-19 20:01:15,620 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-09-19 20:01:15,628 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 32 msec 2023-09-19 20:01:15,637 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-09-19 20:01:15,649 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-09-19 20:01:15,655 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 17 msec 2023-09-19 20:01:15,664 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-09-19 20:01:15,666 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-09-19 20:01:15,667 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.818sec 2023-09-19 20:01:15,671 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-09-19 20:01:15,673 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-09-19 20:01:15,673 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-09-19 20:01:15,675 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37929,1695153671462-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-09-19 20:01:15,676 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37929,1695153671462-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-09-19 20:01:15,705 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-19 20:01:15,707 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-09-19 20:01:15,709 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-09-19 20:01:15,711 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-19 20:01:15,714 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/hbase/acl/d044ee20801cef30a33f2410eddbecac 2023-09-19 20:01:15,715 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-09-19 20:01:15,715 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/hbase/acl/d044ee20801cef30a33f2410eddbecac empty. 2023-09-19 20:01:15,718 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/hbase/acl/d044ee20801cef30a33f2410eddbecac 2023-09-19 20:01:15,718 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-09-19 20:01:15,724 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-19 20:01:15,726 DEBUG [Listener at localhost/45791] zookeeper.ReadOnlyZKClient(139): Connect 0x3a20d86f to 127.0.0.1:60323 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-19 20:01:15,742 DEBUG [Listener at localhost/45791] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3204b0f6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-19 20:01:15,759 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-09-19 20:01:15,762 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => d044ee20801cef30a33f2410eddbecac, NAME => 'hbase:acl,,1695153675699.d044ee20801cef30a33f2410eddbecac.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp 2023-09-19 20:01:15,768 DEBUG [hconnection-0x5a782b32-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 20:01:15,786 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38070, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 20:01:15,787 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1695153675699.d044ee20801cef30a33f2410eddbecac.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 20:01:15,787 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing d044ee20801cef30a33f2410eddbecac, disabling compactions & flushes 2023-09-19 20:01:15,788 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1695153675699.d044ee20801cef30a33f2410eddbecac. 2023-09-19 20:01:15,788 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1695153675699.d044ee20801cef30a33f2410eddbecac. 2023-09-19 20:01:15,788 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1695153675699.d044ee20801cef30a33f2410eddbecac. after waiting 0 ms 2023-09-19 20:01:15,788 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1695153675699.d044ee20801cef30a33f2410eddbecac. 2023-09-19 20:01:15,788 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1695153675699.d044ee20801cef30a33f2410eddbecac. 2023-09-19 20:01:15,788 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for d044ee20801cef30a33f2410eddbecac: 2023-09-19 20:01:15,789 INFO [Listener at localhost/45791] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,37929,1695153671462 2023-09-19 20:01:15,790 INFO [Listener at localhost/45791] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-09-19 20:01:15,790 INFO [Listener at localhost/45791] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59/test.cache.data in system properties and HBase conf 2023-09-19 20:01:15,790 INFO [Listener at localhost/45791] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59/hadoop.tmp.dir in system properties and HBase conf 2023-09-19 20:01:15,790 INFO [Listener at localhost/45791] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59/hadoop.log.dir in system properties and HBase conf 2023-09-19 20:01:15,790 INFO [Listener at localhost/45791] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59/mapreduce.cluster.local.dir in system properties and HBase conf 2023-09-19 20:01:15,790 INFO [Listener at localhost/45791] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-09-19 20:01:15,790 INFO [Listener at localhost/45791] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-09-19 20:01:15,790 INFO [Listener at localhost/45791] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-09-19 20:01:15,790 INFO [Listener at localhost/45791] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-09-19 20:01:15,790 INFO [Listener at localhost/45791] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-09-19 20:01:15,790 INFO [Listener at localhost/45791] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-19 20:01:15,791 INFO [Listener at localhost/45791] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-09-19 20:01:15,791 INFO [Listener at localhost/45791] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-09-19 20:01:15,791 INFO [Listener at localhost/45791] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-19 20:01:15,791 INFO [Listener at localhost/45791] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-19 20:01:15,791 INFO [Listener at localhost/45791] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-09-19 20:01:15,791 INFO [Listener at localhost/45791] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59/nfs.dump.dir in system properties and HBase conf 2023-09-19 20:01:15,791 INFO [Listener at localhost/45791] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59/java.io.tmpdir in system properties and HBase conf 2023-09-19 20:01:15,791 INFO [Listener at localhost/45791] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-19 20:01:15,791 INFO [Listener at localhost/45791] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-09-19 20:01:15,791 INFO [Listener at localhost/45791] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-09-19 20:01:15,792 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-09-19 20:01:15,794 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1695153675699.d044ee20801cef30a33f2410eddbecac.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1695153675794"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695153675794"}]},"ts":"1695153675794"} 2023-09-19 20:01:15,797 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-09-19 20:01:15,799 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-19 20:01:15,799 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695153675799"}]},"ts":"1695153675799"} 2023-09-19 20:01:15,802 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-09-19 20:01:15,807 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-19 20:01:15,808 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-19 20:01:15,808 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-19 20:01:15,808 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-19 20:01:15,808 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-19 20:01:15,808 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=d044ee20801cef30a33f2410eddbecac, ASSIGN}] 2023-09-19 20:01:15,812 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=d044ee20801cef30a33f2410eddbecac, ASSIGN 2023-09-19 20:01:15,814 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=d044ee20801cef30a33f2410eddbecac, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40839,1695153672784; forceNewPlan=false, retain=false 2023-09-19 20:01:15,830 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-19 20:01:15,964 INFO [jenkins-hbase4:37929] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-19 20:01:15,966 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=d044ee20801cef30a33f2410eddbecac, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:15,966 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1695153675699.d044ee20801cef30a33f2410eddbecac.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1695153675966"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695153675966"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695153675966"}]},"ts":"1695153675966"} 2023-09-19 20:01:15,969 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure d044ee20801cef30a33f2410eddbecac, server=jenkins-hbase4.apache.org,40839,1695153672784}] 2023-09-19 20:01:16,030 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-19 20:01:16,124 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:16,124 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-19 20:01:16,126 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34718, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-19 20:01:16,133 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1695153675699.d044ee20801cef30a33f2410eddbecac. 2023-09-19 20:01:16,133 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d044ee20801cef30a33f2410eddbecac, NAME => 'hbase:acl,,1695153675699.d044ee20801cef30a33f2410eddbecac.', STARTKEY => '', ENDKEY => ''} 2023-09-19 20:01:16,134 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1695153675699.d044ee20801cef30a33f2410eddbecac. service=AccessControlService 2023-09-19 20:01:16,134 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-19 20:01:16,134 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl d044ee20801cef30a33f2410eddbecac 2023-09-19 20:01:16,134 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1695153675699.d044ee20801cef30a33f2410eddbecac.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 20:01:16,134 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d044ee20801cef30a33f2410eddbecac 2023-09-19 20:01:16,134 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d044ee20801cef30a33f2410eddbecac 2023-09-19 20:01:16,136 INFO [StoreOpener-d044ee20801cef30a33f2410eddbecac-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region d044ee20801cef30a33f2410eddbecac 2023-09-19 20:01:16,139 DEBUG [StoreOpener-d044ee20801cef30a33f2410eddbecac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/hbase/acl/d044ee20801cef30a33f2410eddbecac/l 2023-09-19 20:01:16,139 DEBUG [StoreOpener-d044ee20801cef30a33f2410eddbecac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/hbase/acl/d044ee20801cef30a33f2410eddbecac/l 2023-09-19 20:01:16,139 INFO [StoreOpener-d044ee20801cef30a33f2410eddbecac-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d044ee20801cef30a33f2410eddbecac columnFamilyName l 2023-09-19 20:01:16,140 INFO [StoreOpener-d044ee20801cef30a33f2410eddbecac-1] regionserver.HStore(310): Store=d044ee20801cef30a33f2410eddbecac/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-19 20:01:16,143 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/hbase/acl/d044ee20801cef30a33f2410eddbecac 2023-09-19 20:01:16,144 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/hbase/acl/d044ee20801cef30a33f2410eddbecac 2023-09-19 20:01:16,150 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d044ee20801cef30a33f2410eddbecac 2023-09-19 20:01:16,155 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/hbase/acl/d044ee20801cef30a33f2410eddbecac/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-19 20:01:16,156 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d044ee20801cef30a33f2410eddbecac; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74650398, jitterRate=0.11237761378288269}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-19 20:01:16,156 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d044ee20801cef30a33f2410eddbecac: 2023-09-19 20:01:16,158 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1695153675699.d044ee20801cef30a33f2410eddbecac., pid=11, masterSystemTime=1695153676124 2023-09-19 20:01:16,162 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1695153675699.d044ee20801cef30a33f2410eddbecac. 2023-09-19 20:01:16,163 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1695153675699.d044ee20801cef30a33f2410eddbecac. 2023-09-19 20:01:16,164 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=d044ee20801cef30a33f2410eddbecac, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:16,164 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1695153675699.d044ee20801cef30a33f2410eddbecac.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1695153676164"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695153676164"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695153676164"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695153676164"}]},"ts":"1695153676164"} 2023-09-19 20:01:16,171 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=11, resume processing ppid=10 2023-09-19 20:01:16,171 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure d044ee20801cef30a33f2410eddbecac, server=jenkins-hbase4.apache.org,40839,1695153672784 in 199 msec 2023-09-19 20:01:16,176 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=10, resume processing ppid=9 2023-09-19 20:01:16,176 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=d044ee20801cef30a33f2410eddbecac, ASSIGN in 363 msec 2023-09-19 20:01:16,177 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-19 20:01:16,177 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695153676177"}]},"ts":"1695153676177"} 2023-09-19 20:01:16,180 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-09-19 20:01:16,183 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-09-19 20:01:16,186 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 478 msec 2023-09-19 20:01:16,331 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-19 20:01:16,331 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-09-19 20:01:16,343 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-09-19 20:01:16,953 WARN [Thread-382] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-19 20:01:17,305 INFO [Thread-382] log.Slf4jLog(67): jetty-6.1.26 2023-09-19 20:01:17,312 INFO [Thread-382] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_39167_jobhistory____.5te4az/webapp 2023-09-19 20:01:17,495 INFO [Thread-382] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-09-19 20:01:17,495 INFO [Thread-382] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-09-19 20:01:17,495 INFO [Thread-382] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-19 20:01:17,498 INFO [Thread-382] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-19 20:01:17,589 INFO [Thread-382] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-19 20:01:17,926 INFO [Thread-382] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-19 20:01:18,218 INFO [Thread-382] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-09-19 20:01:18,251 INFO [Thread-382] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:39167 2023-09-19 20:01:18,448 WARN [Listener at jenkins-hbase4.apache.org/38549] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-19 20:01:18,750 WARN [Listener at jenkins-hbase4.apache.org/38549] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-19 20:01:18,751 INFO [Listener at jenkins-hbase4.apache.org/38549] log.Slf4jLog(67): jetty-6.1.26 2023-09-19 20:01:18,758 INFO [Listener at jenkins-hbase4.apache.org/38549] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_45351_cluster____.qqiqru/webapp 2023-09-19 20:01:18,831 INFO [Listener at jenkins-hbase4.apache.org/38549] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-09-19 20:01:18,832 INFO [Listener at jenkins-hbase4.apache.org/38549] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-09-19 20:01:18,832 INFO [Listener at jenkins-hbase4.apache.org/38549] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-19 20:01:18,832 INFO [Listener at jenkins-hbase4.apache.org/38549] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-19 20:01:18,843 INFO [Listener at jenkins-hbase4.apache.org/38549] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-19 20:01:19,032 INFO [Listener at jenkins-hbase4.apache.org/38549] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-19 20:01:19,113 INFO [Listener at jenkins-hbase4.apache.org/38549] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-19 20:01:19,123 INFO [Listener at jenkins-hbase4.apache.org/38549] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:45351 2023-09-19 20:01:19,600 WARN [Listener at jenkins-hbase4.apache.org/38111] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-19 20:01:19,629 WARN [Listener at jenkins-hbase4.apache.org/38111] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-19 20:01:19,629 INFO [Listener at jenkins-hbase4.apache.org/38111] log.Slf4jLog(67): jetty-6.1.26 2023-09-19 20:01:19,636 INFO [Listener at jenkins-hbase4.apache.org/38111] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_38119_node____.k4joz2/webapp 2023-09-19 20:01:19,717 INFO [Listener at jenkins-hbase4.apache.org/38111] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-09-19 20:01:19,717 INFO [Listener at jenkins-hbase4.apache.org/38111] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-19 20:01:19,717 INFO [Listener at jenkins-hbase4.apache.org/38111] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-09-19 20:01:19,717 INFO [Listener at jenkins-hbase4.apache.org/38111] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-19 20:01:19,726 INFO [Listener at jenkins-hbase4.apache.org/38111] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-19 20:01:19,747 INFO [Listener at jenkins-hbase4.apache.org/38111] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-19 20:01:19,842 INFO [Listener at jenkins-hbase4.apache.org/38111] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-19 20:01:19,856 INFO [Listener at jenkins-hbase4.apache.org/38111] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:38119 2023-09-19 20:01:20,036 WARN [Listener at jenkins-hbase4.apache.org/45213] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-19 20:01:20,043 WARN [Listener at jenkins-hbase4.apache.org/45213] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-19 20:01:20,043 INFO [Listener at jenkins-hbase4.apache.org/45213] log.Slf4jLog(67): jetty-6.1.26 2023-09-19 20:01:20,050 INFO [Listener at jenkins-hbase4.apache.org/45213] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_40551_node____.5tp831/webapp 2023-09-19 20:01:20,101 INFO [Listener at jenkins-hbase4.apache.org/45213] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-09-19 20:01:20,102 INFO [Listener at jenkins-hbase4.apache.org/45213] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-19 20:01:20,102 INFO [Listener at jenkins-hbase4.apache.org/45213] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-09-19 20:01:20,102 INFO [Listener at jenkins-hbase4.apache.org/45213] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-19 20:01:20,112 INFO [Listener at jenkins-hbase4.apache.org/45213] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-19 20:01:20,127 INFO [Listener at jenkins-hbase4.apache.org/45213] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-19 20:01:20,203 INFO [Listener at jenkins-hbase4.apache.org/45213] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-19 20:01:20,211 INFO [Listener at jenkins-hbase4.apache.org/45213] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:40551 2023-09-19 20:01:20,213 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-19 20:01:20,264 INFO [Listener at jenkins-hbase4.apache.org/45213] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-09-19 20:01:20,266 INFO [Listener at jenkins-hbase4.apache.org/45213] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-09-19 20:01:20,342 INFO [Listener at jenkins-hbase4.apache.org/45213] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=706, OpenFileDescriptor=899, MaxFileDescriptor=60000, SystemLoadAverage=147, ProcessCount=165, AvailableMemoryMB=8763 2023-09-19 20:01:20,342 WARN [Listener at jenkins-hbase4.apache.org/45213] hbase.ResourceChecker(130): Thread=706 is superior to 500 2023-09-19 20:01:20,364 DEBUG [Listener at jenkins-hbase4.apache.org/45213] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-09-19 20:01:20,374 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44732, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-09-19 20:01:20,385 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-19 20:01:20,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] procedure2.ProcedureExecutor(1028): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-09-19 20:01:20,392 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-09-19 20:01:20,396 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-09-19 20:01:20,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-19 20:01:20,398 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-19 20:01:20,404 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportWithTargetName/e6acfe578bb6e8712a5b89cd0f53982f 2023-09-19 20:01:20,410 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportWithTargetName/e6acfe578bb6e8712a5b89cd0f53982f empty. 2023-09-19 20:01:20,410 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportWithTargetName/a978529be43650801b49b2fd94a006e7 2023-09-19 20:01:20,411 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportWithTargetName/e6acfe578bb6e8712a5b89cd0f53982f 2023-09-19 20:01:20,415 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportWithTargetName/a978529be43650801b49b2fd94a006e7 empty. 2023-09-19 20:01:20,417 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportWithTargetName/a978529be43650801b49b2fd94a006e7 2023-09-19 20:01:20,417 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-09-19 20:01:20,438 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-09-19 20:01:20,440 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-09-19 20:01:20,441 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-09-19 20:01:20,461 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-09-19 20:01:20,462 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => e6acfe578bb6e8712a5b89cd0f53982f, NAME => 'testtb-testExportWithTargetName,,1695153680384.e6acfe578bb6e8712a5b89cd0f53982f.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp 2023-09-19 20:01:20,463 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => a978529be43650801b49b2fd94a006e7, NAME => 'testtb-testExportWithTargetName,1,1695153680384.a978529be43650801b49b2fd94a006e7.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp 2023-09-19 20:01:20,503 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1695153680384.e6acfe578bb6e8712a5b89cd0f53982f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 20:01:20,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-19 20:01:20,506 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing e6acfe578bb6e8712a5b89cd0f53982f, disabling compactions & flushes 2023-09-19 20:01:20,507 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1695153680384.e6acfe578bb6e8712a5b89cd0f53982f. 2023-09-19 20:01:20,507 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1695153680384.e6acfe578bb6e8712a5b89cd0f53982f. 2023-09-19 20:01:20,507 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1695153680384.e6acfe578bb6e8712a5b89cd0f53982f. after waiting 0 ms 2023-09-19 20:01:20,507 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1695153680384.e6acfe578bb6e8712a5b89cd0f53982f. 2023-09-19 20:01:20,507 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1695153680384.a978529be43650801b49b2fd94a006e7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 20:01:20,507 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1695153680384.e6acfe578bb6e8712a5b89cd0f53982f. 2023-09-19 20:01:20,507 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing a978529be43650801b49b2fd94a006e7, disabling compactions & flushes 2023-09-19 20:01:20,507 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for e6acfe578bb6e8712a5b89cd0f53982f: 2023-09-19 20:01:20,507 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1695153680384.a978529be43650801b49b2fd94a006e7. 2023-09-19 20:01:20,507 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1695153680384.a978529be43650801b49b2fd94a006e7. 2023-09-19 20:01:20,507 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1695153680384.a978529be43650801b49b2fd94a006e7. after waiting 0 ms 2023-09-19 20:01:20,507 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1695153680384.a978529be43650801b49b2fd94a006e7. 2023-09-19 20:01:20,507 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1695153680384.a978529be43650801b49b2fd94a006e7. 2023-09-19 20:01:20,507 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for a978529be43650801b49b2fd94a006e7: 2023-09-19 20:01:20,511 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-09-19 20:01:20,512 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1695153680384.e6acfe578bb6e8712a5b89cd0f53982f.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695153680512"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695153680512"}]},"ts":"1695153680512"} 2023-09-19 20:01:20,513 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1695153680384.a978529be43650801b49b2fd94a006e7.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695153680512"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695153680512"}]},"ts":"1695153680512"} 2023-09-19 20:01:20,562 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-19 20:01:20,563 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-19 20:01:20,563 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695153680563"}]},"ts":"1695153680563"} 2023-09-19 20:01:20,566 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-09-19 20:01:20,572 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-19 20:01:20,574 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-19 20:01:20,574 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-19 20:01:20,574 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-19 20:01:20,574 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-19 20:01:20,574 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e6acfe578bb6e8712a5b89cd0f53982f, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a978529be43650801b49b2fd94a006e7, ASSIGN}] 2023-09-19 20:01:20,577 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a978529be43650801b49b2fd94a006e7, ASSIGN 2023-09-19 20:01:20,577 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e6acfe578bb6e8712a5b89cd0f53982f, ASSIGN 2023-09-19 20:01:20,579 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a978529be43650801b49b2fd94a006e7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45123,1695153672695; forceNewPlan=false, retain=false 2023-09-19 20:01:20,579 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e6acfe578bb6e8712a5b89cd0f53982f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40839,1695153672784; forceNewPlan=false, retain=false 2023-09-19 20:01:20,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-19 20:01:20,729 INFO [jenkins-hbase4:37929] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-19 20:01:20,731 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=e6acfe578bb6e8712a5b89cd0f53982f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:20,731 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=a978529be43650801b49b2fd94a006e7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:20,732 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1695153680384.e6acfe578bb6e8712a5b89cd0f53982f.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695153680731"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695153680731"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695153680731"}]},"ts":"1695153680731"} 2023-09-19 20:01:20,732 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1695153680384.a978529be43650801b49b2fd94a006e7.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695153680731"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695153680731"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695153680731"}]},"ts":"1695153680731"} 2023-09-19 20:01:20,734 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=15, ppid=13, state=RUNNABLE; OpenRegionProcedure e6acfe578bb6e8712a5b89cd0f53982f, server=jenkins-hbase4.apache.org,40839,1695153672784}] 2023-09-19 20:01:20,736 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=16, ppid=14, state=RUNNABLE; OpenRegionProcedure a978529be43650801b49b2fd94a006e7, server=jenkins-hbase4.apache.org,45123,1695153672695}] 2023-09-19 20:01:20,894 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1695153680384.e6acfe578bb6e8712a5b89cd0f53982f. 2023-09-19 20:01:20,894 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e6acfe578bb6e8712a5b89cd0f53982f, NAME => 'testtb-testExportWithTargetName,,1695153680384.e6acfe578bb6e8712a5b89cd0f53982f.', STARTKEY => '', ENDKEY => '1'} 2023-09-19 20:01:20,894 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1695153680384.e6acfe578bb6e8712a5b89cd0f53982f. service=AccessControlService 2023-09-19 20:01:20,895 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-19 20:01:20,895 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName e6acfe578bb6e8712a5b89cd0f53982f 2023-09-19 20:01:20,895 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1695153680384.e6acfe578bb6e8712a5b89cd0f53982f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 20:01:20,895 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e6acfe578bb6e8712a5b89cd0f53982f 2023-09-19 20:01:20,895 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e6acfe578bb6e8712a5b89cd0f53982f 2023-09-19 20:01:20,897 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1695153680384.a978529be43650801b49b2fd94a006e7. 2023-09-19 20:01:20,897 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a978529be43650801b49b2fd94a006e7, NAME => 'testtb-testExportWithTargetName,1,1695153680384.a978529be43650801b49b2fd94a006e7.', STARTKEY => '1', ENDKEY => ''} 2023-09-19 20:01:20,897 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1695153680384.a978529be43650801b49b2fd94a006e7. service=AccessControlService 2023-09-19 20:01:20,897 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-19 20:01:20,898 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName a978529be43650801b49b2fd94a006e7 2023-09-19 20:01:20,898 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1695153680384.a978529be43650801b49b2fd94a006e7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 20:01:20,898 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a978529be43650801b49b2fd94a006e7 2023-09-19 20:01:20,898 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a978529be43650801b49b2fd94a006e7 2023-09-19 20:01:20,900 INFO [StoreOpener-a978529be43650801b49b2fd94a006e7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a978529be43650801b49b2fd94a006e7 2023-09-19 20:01:20,900 INFO [StoreOpener-e6acfe578bb6e8712a5b89cd0f53982f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e6acfe578bb6e8712a5b89cd0f53982f 2023-09-19 20:01:20,903 DEBUG [StoreOpener-e6acfe578bb6e8712a5b89cd0f53982f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportWithTargetName/e6acfe578bb6e8712a5b89cd0f53982f/cf 2023-09-19 20:01:20,903 DEBUG [StoreOpener-e6acfe578bb6e8712a5b89cd0f53982f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportWithTargetName/e6acfe578bb6e8712a5b89cd0f53982f/cf 2023-09-19 20:01:20,903 DEBUG [StoreOpener-a978529be43650801b49b2fd94a006e7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportWithTargetName/a978529be43650801b49b2fd94a006e7/cf 2023-09-19 20:01:20,903 DEBUG [StoreOpener-a978529be43650801b49b2fd94a006e7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportWithTargetName/a978529be43650801b49b2fd94a006e7/cf 2023-09-19 20:01:20,907 INFO [StoreOpener-e6acfe578bb6e8712a5b89cd0f53982f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e6acfe578bb6e8712a5b89cd0f53982f columnFamilyName cf 2023-09-19 20:01:20,907 INFO [StoreOpener-a978529be43650801b49b2fd94a006e7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a978529be43650801b49b2fd94a006e7 columnFamilyName cf 2023-09-19 20:01:20,911 INFO [StoreOpener-a978529be43650801b49b2fd94a006e7-1] regionserver.HStore(310): Store=a978529be43650801b49b2fd94a006e7/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-19 20:01:20,911 INFO [StoreOpener-e6acfe578bb6e8712a5b89cd0f53982f-1] regionserver.HStore(310): Store=e6acfe578bb6e8712a5b89cd0f53982f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-19 20:01:20,914 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportWithTargetName/a978529be43650801b49b2fd94a006e7 2023-09-19 20:01:20,914 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportWithTargetName/e6acfe578bb6e8712a5b89cd0f53982f 2023-09-19 20:01:20,915 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportWithTargetName/a978529be43650801b49b2fd94a006e7 2023-09-19 20:01:20,915 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportWithTargetName/e6acfe578bb6e8712a5b89cd0f53982f 2023-09-19 20:01:20,920 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a978529be43650801b49b2fd94a006e7 2023-09-19 20:01:20,920 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e6acfe578bb6e8712a5b89cd0f53982f 2023-09-19 20:01:20,924 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportWithTargetName/a978529be43650801b49b2fd94a006e7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-19 20:01:20,924 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportWithTargetName/e6acfe578bb6e8712a5b89cd0f53982f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-19 20:01:20,926 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e6acfe578bb6e8712a5b89cd0f53982f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65015352, jitterRate=-0.031195759773254395}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-19 20:01:20,926 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a978529be43650801b49b2fd94a006e7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69457314, jitterRate=0.03499463200569153}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-19 20:01:20,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e6acfe578bb6e8712a5b89cd0f53982f: 2023-09-19 20:01:20,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a978529be43650801b49b2fd94a006e7: 2023-09-19 20:01:20,927 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1695153680384.a978529be43650801b49b2fd94a006e7., pid=16, masterSystemTime=1695153680890 2023-09-19 20:01:20,927 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1695153680384.e6acfe578bb6e8712a5b89cd0f53982f., pid=15, masterSystemTime=1695153680887 2023-09-19 20:01:20,932 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=a978529be43650801b49b2fd94a006e7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:20,932 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1695153680384.a978529be43650801b49b2fd94a006e7.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695153680931"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695153680931"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695153680931"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695153680931"}]},"ts":"1695153680931"} 2023-09-19 20:01:20,932 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1695153680384.e6acfe578bb6e8712a5b89cd0f53982f. 2023-09-19 20:01:20,932 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1695153680384.e6acfe578bb6e8712a5b89cd0f53982f. 2023-09-19 20:01:20,933 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1695153680384.a978529be43650801b49b2fd94a006e7. 2023-09-19 20:01:20,935 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1695153680384.a978529be43650801b49b2fd94a006e7. 2023-09-19 20:01:20,935 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=e6acfe578bb6e8712a5b89cd0f53982f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:20,935 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1695153680384.e6acfe578bb6e8712a5b89cd0f53982f.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695153680935"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695153680935"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695153680935"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695153680935"}]},"ts":"1695153680935"} 2023-09-19 20:01:20,941 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=16, resume processing ppid=14 2023-09-19 20:01:20,941 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=16, ppid=14, state=SUCCESS; OpenRegionProcedure a978529be43650801b49b2fd94a006e7, server=jenkins-hbase4.apache.org,45123,1695153672695 in 201 msec 2023-09-19 20:01:20,943 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=15, resume processing ppid=13 2023-09-19 20:01:20,944 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=15, ppid=13, state=SUCCESS; OpenRegionProcedure e6acfe578bb6e8712a5b89cd0f53982f, server=jenkins-hbase4.apache.org,40839,1695153672784 in 205 msec 2023-09-19 20:01:20,945 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a978529be43650801b49b2fd94a006e7, ASSIGN in 367 msec 2023-09-19 20:01:20,948 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=13, resume processing ppid=12 2023-09-19 20:01:20,948 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e6acfe578bb6e8712a5b89cd0f53982f, ASSIGN in 369 msec 2023-09-19 20:01:20,949 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-19 20:01:20,950 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695153680950"}]},"ts":"1695153680950"} 2023-09-19 20:01:20,952 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-09-19 20:01:20,955 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-09-19 20:01:20,960 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-09-19 20:01:20,966 DEBUG [PEWorker-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 20:01:20,969 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34734, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 20:01:20,973 DEBUG [hconnection-0x73e2f207-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 20:01:20,975 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38086, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=ClientService 2023-09-19 20:01:20,983 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40839] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-19 20:01:21,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-19 20:01:21,013 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-19 20:01:21,013 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-19 20:01:21,013 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-19 20:01:21,013 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-19 20:01:21,013 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-19 20:01:21,021 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-19 20:01:21,022 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-19 20:01:21,021 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-19 20:01:21,021 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-19 20:01:21,025 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 637 msec 2023-09-19 20:01:21,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-19 20:01:21,512 INFO [Listener at jenkins-hbase4.apache.org/45213] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-09-19 20:01:21,516 DEBUG [Listener at jenkins-hbase4.apache.org/45213] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-09-19 20:01:21,518 DEBUG [Listener at jenkins-hbase4.apache.org/45213] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1695153680384.e6acfe578bb6e8712a5b89cd0f53982f. 2023-09-19 20:01:21,520 INFO [Listener at jenkins-hbase4.apache.org/45213] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-19 20:01:21,543 DEBUG [hconnection-0x5a782b32-shared-pool-4] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 20:01:21,547 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34748, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 20:01:21,568 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-19 20:01:21,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695153681568 (current time:1695153681568). 2023-09-19 20:01:21,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-19 20:01:21,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] zookeeper.ReadOnlyZKClient(139): Connect 0x564045ba to 127.0.0.1:60323 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-19 20:01:21,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@9d9f374, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-19 20:01:21,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 20:01:21,580 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38098, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 20:01:21,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x564045ba to 127.0.0.1:60323 2023-09-19 20:01:21,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 20:01:21,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] zookeeper.ReadOnlyZKClient(139): Connect 0x1c2076b2 to 127.0.0.1:60323 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-19 20:01:21,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@52a582cb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-19 20:01:21,594 DEBUG [hconnection-0x30f351df-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 20:01:21,595 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38108, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 20:01:21,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 20:01:21,603 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34750, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 20:01:21,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1c2076b2 to 127.0.0.1:60323 2023-09-19 20:01:21,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 20:01:21,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-19 20:01:21,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-19 20:01:21,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-19 20:01:21,638 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-19 20:01:21,639 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-09-19 20:01:21,639 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-19 20:01:21,639 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-09-19 20:01:21,639 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-09-19 20:01:21,639 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-09-19 20:01:21,639 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-19 20:01:21,640 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-09-19 20:01:21,640 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-09-19 20:01:21,640 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-09-19 20:01:21,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] procedure2.ProcedureExecutor(1028): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-19 20:01:21,653 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-19 20:01:21,655 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1695154281655 2023-09-19 20:01:21,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-19 20:01:21,655 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-09-19 20:01:21,658 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-19 20:01:21,659 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-19 20:01:21,662 DEBUG [Listener at jenkins-hbase4.apache.org/45213] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-19 20:01:21,662 DEBUG [Listener at jenkins-hbase4.apache.org/45213] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-19 20:01:21,662 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 14 msec 2023-09-19 20:01:21,663 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-19 20:01:21,664 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1695154281664 2023-09-19 20:01:21,694 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-09-19 20:01:21,694 INFO [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-09-19 20:01:21,694 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 20:01:21,695 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-09-19 20:01:21,695 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-09-19 20:01:21,696 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-19 20:01:21,696 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-19 20:01:21,701 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 20:01:21,701 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 20:01:21,701 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 20:01:21,701 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 20:01:21,701 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 20:01:21,701 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 20:01:21,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 20:01:21,701 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:21,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 20:01:21,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 20:01:21,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-19 20:01:21,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-19 20:01:21,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-19 20:01:21,702 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:21,702 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:21,703 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-19 20:01:21,703 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-19 20:01:21,703 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-19 20:01:21,703 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:21,703 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-19 20:01:21,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-19 20:01:21,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-19 20:01:21,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-19 20:01:21,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-19 20:01:21,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-19 20:01:21,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-19 20:01:21,705 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-19 20:01:21,705 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-19 20:01:21,705 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-19 20:01:21,707 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-19 20:01:21,707 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-19 20:01:21,707 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-19 20:01:21,708 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-19 20:01:21,708 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-19 20:01:21,708 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-19 20:01:21,708 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 20:01:21,708 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 20:01:21,708 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 20:01:21,711 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-19 20:01:21,712 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-19 20:01:21,712 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-19 20:01:21,711 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-19 20:01:21,712 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40397,1695153672742' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-19 20:01:21,712 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-19 20:01:21,712 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-19 20:01:21,712 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40839,1695153672784' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-19 20:01:21,712 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45123,1695153672695' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-19 20:01:21,715 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-19 20:01:21,716 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:21,716 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-19 20:01:21,716 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-19 20:01:21,716 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-19 20:01:21,716 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 20:01:21,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:21,716 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:21,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 20:01:21,716 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-19 20:01:21,716 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-19 20:01:21,716 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 20:01:21,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 20:01:21,716 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 20:01:21,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 20:01:21,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 20:01:21,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-19 20:01:21,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:21,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:21,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:21,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 20:01:21,720 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40839,1695153672784' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-09-19 20:01:21,720 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3b4d667d[Count = 1] remaining members to acquire global barrier 2023-09-19 20:01:21,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:21,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 20:01:21,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 20:01:21,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 20:01:21,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 20:01:21,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-19 20:01:21,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:21,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:21,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:21,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 20:01:21,723 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45123,1695153672695' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-09-19 20:01:21,723 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3b4d667d[Count = 0] remaining members to acquire global barrier 2023-09-19 20:01:21,723 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-09-19 20:01:21,723 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-19 20:01:21,726 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-19 20:01:21,726 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-19 20:01:21,726 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-19 20:01:21,726 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-19 20:01:21,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-19 20:01:21,726 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-19 20:01:21,727 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:21,727 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-19 20:01:21,727 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-19 20:01:21,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-19 20:01:21,727 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-19 20:01:21,727 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-19 20:01:21,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-19 20:01:21,727 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:21,727 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-19 20:01:21,727 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,40397,1695153672742' in zk 2023-09-19 20:01:21,727 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-19 20:01:21,728 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-19 20:01:21,728 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-19 20:01:21,728 DEBUG [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1695153680384.e6acfe578bb6e8712a5b89cd0f53982f. 2023-09-19 20:01:21,728 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-19 20:01:21,728 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-19 20:01:21,728 DEBUG [rs(jenkins-hbase4.apache.org,45123,1695153672695)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1695153680384.a978529be43650801b49b2fd94a006e7. 2023-09-19 20:01:21,730 DEBUG [rs(jenkins-hbase4.apache.org,45123,1695153672695)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1695153680384.a978529be43650801b49b2fd94a006e7. started... 2023-09-19 20:01:21,730 DEBUG [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1695153680384.e6acfe578bb6e8712a5b89cd0f53982f. started... 2023-09-19 20:01:21,730 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-19 20:01:21,730 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 20:01:21,730 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-19 20:01:21,733 DEBUG [rs(jenkins-hbase4.apache.org,45123,1695153672695)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a978529be43650801b49b2fd94a006e7: 2023-09-19 20:01:21,733 DEBUG [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e6acfe578bb6e8712a5b89cd0f53982f: 2023-09-19 20:01:21,734 DEBUG [rs(jenkins-hbase4.apache.org,45123,1695153672695)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1695153680384.a978529be43650801b49b2fd94a006e7.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-19 20:01:21,734 DEBUG [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1695153680384.e6acfe578bb6e8712a5b89cd0f53982f.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-19 20:01:21,740 DEBUG [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-19 20:01:21,740 DEBUG [rs(jenkins-hbase4.apache.org,45123,1695153672695)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-19 20:01:21,743 DEBUG [rs(jenkins-hbase4.apache.org,45123,1695153672695)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-19 20:01:21,743 DEBUG [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-19 20:01:21,766 DEBUG [Listener at jenkins-hbase4.apache.org/45213] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-19 20:01:21,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-19 20:01:21,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-19 20:01:21,782 DEBUG [Listener at jenkins-hbase4.apache.org/45213] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-19 20:01:21,782 DEBUG [rs(jenkins-hbase4.apache.org,45123,1695153672695)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1695153680384.a978529be43650801b49b2fd94a006e7. completed. 2023-09-19 20:01:21,782 DEBUG [rs(jenkins-hbase4.apache.org,45123,1695153672695)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1695153680384.a978529be43650801b49b2fd94a006e7. 2023-09-19 20:01:21,783 DEBUG [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1695153680384.e6acfe578bb6e8712a5b89cd0f53982f. completed. 2023-09-19 20:01:21,783 DEBUG [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1695153680384.e6acfe578bb6e8712a5b89cd0f53982f. 2023-09-19 20:01:21,783 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-19 20:01:21,783 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-19 20:01:21,783 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-19 20:01:21,783 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-19 20:01:21,783 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:21,783 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:21,783 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-19 20:01:21,783 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-19 20:01:21,783 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,45123,1695153672695' in zk 2023-09-19 20:01:21,783 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,40839,1695153672784' in zk 2023-09-19 20:01:21,786 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:21,786 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-19 20:01:21,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:21,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 20:01:21,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 20:01:21,787 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 20:01:21,787 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-19 20:01:21,788 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-19 20:01:21,788 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:21,788 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 20:01:21,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 20:01:21,788 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-19 20:01:21,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 20:01:21,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-19 20:01:21,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:21,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:21,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:21,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 20:01:21,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-19 20:01:21,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:21,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:21,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:21,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,40839,1695153672784': 2023-09-19 20:01:21,794 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40839,1695153672784' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-09-19 20:01:21,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:21,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 20:01:21,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 20:01:21,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 20:01:21,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 20:01:21,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-19 20:01:21,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:21,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:21,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:21,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 20:01:21,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-19 20:01:21,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:21,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:21,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:21,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,45123,1695153672695': 2023-09-19 20:01:21,799 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45123,1695153672695' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-09-19 20:01:21,799 INFO [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-09-19 20:01:21,799 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-19 20:01:21,799 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-19 20:01:21,799 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-09-19 20:01:21,799 INFO [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-19 20:01:21,803 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-19 20:01:21,803 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-19 20:01:21,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-19 20:01:21,803 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-19 20:01:21,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 20:01:21,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 20:01:21,803 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 20:01:21,803 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-19 20:01:21,803 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-19 20:01:21,803 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-19 20:01:21,803 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-19 20:01:21,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-19 20:01:21,803 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 20:01:21,803 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 20:01:21,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-19 20:01:21,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 20:01:21,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-19 20:01:21,804 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 20:01:21,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 20:01:21,804 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 20:01:21,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 20:01:21,804 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:21,805 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 20:01:21,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 20:01:21,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-19 20:01:21,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-19 20:01:21,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-19 20:01:21,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-19 20:01:21,805 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:21,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 20:01:21,806 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:21,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-19 20:01:21,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:21,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:21,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:21,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 20:01:21,808 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:21,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-19 20:01:21,809 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:21,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:21,809 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:21,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:21,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:21,822 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:21,822 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 20:01:21,822 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 20:01:21,822 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-19 20:01:21,822 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 20:01:21,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 20:01:21,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 20:01:21,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 20:01:21,822 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 20:01:21,822 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-09-19 20:01:21,822 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 20:01:21,822 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-09-19 20:01:21,822 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 20:01:21,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 20:01:21,822 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:21,823 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 20:01:21,823 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-19 20:01:21,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 20:01:21,823 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-19 20:01:21,822 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 20:01:21,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 20:01:21,824 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 20:01:21,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 20:01:21,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 20:01:21,823 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:21,824 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-19 20:01:21,824 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:21,824 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-19 20:01:21,824 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:21,824 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:21,824 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-19 20:01:21,824 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-19 20:01:21,825 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 20:01:21,825 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-19 20:01:21,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 20:01:21,843 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-09-19 20:01:21,846 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-19 20:01:21,899 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-09-19 20:01:21,900 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-09-19 20:01:21,900 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-19 20:01:21,901 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-19 20:01:21,902 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1695153681655Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1695153681843 (+188 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1695153681843Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1695153681843Writing data manifest for emptySnaptb0-testExportWithTargetName at 1695153681861 (+18 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1695153681888 (+27 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1695153681900 (+12 ms) 2023-09-19 20:01:21,904 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-19 20:01:21,906 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 247 msec 2023-09-19 20:01:21,982 DEBUG [Listener at jenkins-hbase4.apache.org/45213] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-19 20:01:21,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-19 20:01:21,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-19 20:01:22,006 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40839] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1695153680384.e6acfe578bb6e8712a5b89cd0f53982f. with WAL disabled. Data may be lost in the event of a crash. 2023-09-19 20:01:22,008 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45123] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1695153680384.a978529be43650801b49b2fd94a006e7. with WAL disabled. Data may be lost in the event of a crash. 2023-09-19 20:01:22,014 DEBUG [Listener at jenkins-hbase4.apache.org/45213] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-09-19 20:01:22,014 DEBUG [Listener at jenkins-hbase4.apache.org/45213] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1695153680384.e6acfe578bb6e8712a5b89cd0f53982f. 2023-09-19 20:01:22,014 INFO [Listener at jenkins-hbase4.apache.org/45213] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-19 20:01:22,030 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-19 20:01:22,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695153682030 (current time:1695153682030). 2023-09-19 20:01:22,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-19 20:01:22,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] zookeeper.ReadOnlyZKClient(139): Connect 0x692a098e to 127.0.0.1:60323 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-19 20:01:22,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6a496081, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-19 20:01:22,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 20:01:22,043 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38124, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 20:01:22,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x692a098e to 127.0.0.1:60323 2023-09-19 20:01:22,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 20:01:22,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] zookeeper.ReadOnlyZKClient(139): Connect 0x7669bfd4 to 127.0.0.1:60323 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-19 20:01:22,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4f36beee, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-19 20:01:22,054 DEBUG [hconnection-0x6eda82e1-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 20:01:22,057 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38136, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 20:01:22,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 20:01:22,062 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34760, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 20:01:22,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7669bfd4 to 127.0.0.1:60323 2023-09-19 20:01:22,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 20:01:22,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-19 20:01:22,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-19 20:01:22,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-19 20:01:22,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] procedure2.ProcedureExecutor(1028): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-19 20:01:22,069 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-19 20:01:22,071 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1695154282071 2023-09-19 20:01:22,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-19 20:01:22,071 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-09-19 20:01:22,072 DEBUG [Listener at jenkins-hbase4.apache.org/45213] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-19 20:01:22,072 DEBUG [Listener at jenkins-hbase4.apache.org/45213] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-19 20:01:22,073 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-19 20:01:22,073 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-19 20:01:22,075 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 6 msec 2023-09-19 20:01:22,076 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-19 20:01:22,076 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1695154282076 2023-09-19 20:01:22,093 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-09-19 20:01:22,093 INFO [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-09-19 20:01:22,093 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 20:01:22,094 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-09-19 20:01:22,094 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-09-19 20:01:22,095 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-19 20:01:22,095 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-19 20:01:22,096 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 20:01:22,096 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 20:01:22,096 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 20:01:22,096 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 20:01:22,096 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:22,096 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 20:01:22,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 20:01:22,097 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 20:01:22,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 20:01:22,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 20:01:22,097 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:22,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-19 20:01:22,097 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:22,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-19 20:01:22,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-19 20:01:22,097 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:22,097 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-19 20:01:22,097 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-19 20:01:22,098 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-19 20:01:22,098 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-19 20:01:22,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-19 20:01:22,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-19 20:01:22,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-19 20:01:22,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-19 20:01:22,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-19 20:01:22,098 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-19 20:01:22,098 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-19 20:01:22,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-19 20:01:22,098 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-19 20:01:22,099 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-19 20:01:22,099 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-19 20:01:22,099 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-19 20:01:22,099 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-19 20:01:22,099 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 20:01:22,099 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-19 20:01:22,100 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-19 20:01:22,100 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 20:01:22,099 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-19 20:01:22,101 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-19 20:01:22,101 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-19 20:01:22,101 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 20:01:22,100 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-19 20:01:22,102 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-19 20:01:22,102 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-19 20:01:22,102 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40839,1695153672784' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-19 20:01:22,101 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45123,1695153672695' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-19 20:01:22,102 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40397,1695153672742' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-19 20:01:22,104 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-19 20:01:22,104 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:22,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:22,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 20:01:22,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 20:01:22,106 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-19 20:01:22,106 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-19 20:01:22,106 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-19 20:01:22,106 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 20:01:22,106 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:22,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 20:01:22,106 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-19 20:01:22,106 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 20:01:22,107 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-19 20:01:22,107 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 20:01:22,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 20:01:22,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-19 20:01:22,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:22,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:22,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:22,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 20:01:22,109 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40839,1695153672784' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-09-19 20:01:22,109 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@74c31c8d[Count = 1] remaining members to acquire global barrier 2023-09-19 20:01:22,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:22,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 20:01:22,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 20:01:22,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 20:01:22,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 20:01:22,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-19 20:01:22,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:22,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:22,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:22,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 20:01:22,112 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45123,1695153672695' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-09-19 20:01:22,112 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@74c31c8d[Count = 0] remaining members to acquire global barrier 2023-09-19 20:01:22,112 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-09-19 20:01:22,112 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-19 20:01:22,116 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-19 20:01:22,116 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-19 20:01:22,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-19 20:01:22,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-19 20:01:22,116 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-19 20:01:22,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-19 20:01:22,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-19 20:01:22,116 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-19 20:01:22,116 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-19 20:01:22,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-19 20:01:22,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-19 20:01:22,116 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:22,116 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-19 20:01:22,116 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-19 20:01:22,116 DEBUG [rs(jenkins-hbase4.apache.org,45123,1695153672695)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1695153680384.a978529be43650801b49b2fd94a006e7. 2023-09-19 20:01:22,116 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-19 20:01:22,116 DEBUG [rs(jenkins-hbase4.apache.org,45123,1695153672695)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1695153680384.a978529be43650801b49b2fd94a006e7. started... 2023-09-19 20:01:22,116 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-19 20:01:22,116 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-19 20:01:22,117 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:22,116 DEBUG [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1695153680384.e6acfe578bb6e8712a5b89cd0f53982f. 2023-09-19 20:01:22,116 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-19 20:01:22,117 DEBUG [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1695153680384.e6acfe578bb6e8712a5b89cd0f53982f. started... 2023-09-19 20:01:22,117 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-19 20:01:22,117 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,40397,1695153672742' in zk 2023-09-19 20:01:22,117 INFO [rs(jenkins-hbase4.apache.org,45123,1695153672695)-snapshot-pool-0] regionserver.HRegion(2745): Flushing a978529be43650801b49b2fd94a006e7 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-09-19 20:01:22,117 INFO [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] regionserver.HRegion(2745): Flushing e6acfe578bb6e8712a5b89cd0f53982f 1/1 column families, dataSize=266 B heapSize=832 B 2023-09-19 20:01:22,120 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-19 20:01:22,120 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 20:01:22,120 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-19 20:01:22,172 DEBUG [Listener at jenkins-hbase4.apache.org/45213] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-19 20:01:22,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-19 20:01:22,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-19 20:01:22,174 DEBUG [Listener at jenkins-hbase4.apache.org/45213] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-19 20:01:22,259 INFO [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230919fa92021afd3b481d9e003661000a5db6 to hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230919fa92021afd3b481d9e003661000a5db6 2023-09-19 20:01:22,259 INFO [rs(jenkins-hbase4.apache.org,45123,1695153672695)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023091955203c36b55248e8a3830bc020725523 to hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023091955203c36b55248e8a3830bc020725523 2023-09-19 20:01:22,296 INFO [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportWithTargetName/e6acfe578bb6e8712a5b89cd0f53982f/.tmp/cf/8defc9b68f6f47838a38ab6eb26f332f 2023-09-19 20:01:22,298 INFO [rs(jenkins-hbase4.apache.org,45123,1695153672695)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportWithTargetName/a978529be43650801b49b2fd94a006e7/.tmp/cf/a235b37e3fa646af97ceba1a457f770b 2023-09-19 20:01:22,308 DEBUG [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportWithTargetName/e6acfe578bb6e8712a5b89cd0f53982f/.tmp/cf/8defc9b68f6f47838a38ab6eb26f332f as hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportWithTargetName/e6acfe578bb6e8712a5b89cd0f53982f/cf/8defc9b68f6f47838a38ab6eb26f332f 2023-09-19 20:01:22,308 DEBUG [rs(jenkins-hbase4.apache.org,45123,1695153672695)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportWithTargetName/a978529be43650801b49b2fd94a006e7/.tmp/cf/a235b37e3fa646af97ceba1a457f770b as hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportWithTargetName/a978529be43650801b49b2fd94a006e7/cf/a235b37e3fa646af97ceba1a457f770b 2023-09-19 20:01:22,318 INFO [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportWithTargetName/e6acfe578bb6e8712a5b89cd0f53982f/cf/8defc9b68f6f47838a38ab6eb26f332f, entries=4, sequenceid=6, filesize=5.6 K 2023-09-19 20:01:22,318 INFO [rs(jenkins-hbase4.apache.org,45123,1695153672695)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportWithTargetName/a978529be43650801b49b2fd94a006e7/cf/a235b37e3fa646af97ceba1a457f770b, entries=46, sequenceid=6, filesize=12.6 K 2023-09-19 20:01:22,324 INFO [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for e6acfe578bb6e8712a5b89cd0f53982f in 207ms, sequenceid=6, compaction requested=false 2023-09-19 20:01:22,324 INFO [rs(jenkins-hbase4.apache.org,45123,1695153672695)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for a978529be43650801b49b2fd94a006e7 in 207ms, sequenceid=6, compaction requested=false 2023-09-19 20:01:22,324 DEBUG [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-09-19 20:01:22,324 DEBUG [rs(jenkins-hbase4.apache.org,45123,1695153672695)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-09-19 20:01:22,327 DEBUG [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e6acfe578bb6e8712a5b89cd0f53982f: 2023-09-19 20:01:22,327 DEBUG [rs(jenkins-hbase4.apache.org,45123,1695153672695)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a978529be43650801b49b2fd94a006e7: 2023-09-19 20:01:22,327 DEBUG [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1695153680384.e6acfe578bb6e8712a5b89cd0f53982f.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-19 20:01:22,327 DEBUG [rs(jenkins-hbase4.apache.org,45123,1695153672695)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1695153680384.a978529be43650801b49b2fd94a006e7.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-19 20:01:22,327 DEBUG [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-19 20:01:22,327 DEBUG [rs(jenkins-hbase4.apache.org,45123,1695153672695)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-19 20:01:22,328 DEBUG [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportWithTargetName/e6acfe578bb6e8712a5b89cd0f53982f/cf/8defc9b68f6f47838a38ab6eb26f332f] hfiles 2023-09-19 20:01:22,328 DEBUG [rs(jenkins-hbase4.apache.org,45123,1695153672695)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportWithTargetName/a978529be43650801b49b2fd94a006e7/cf/a235b37e3fa646af97ceba1a457f770b] hfiles 2023-09-19 20:01:22,328 DEBUG [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportWithTargetName/e6acfe578bb6e8712a5b89cd0f53982f/cf/8defc9b68f6f47838a38ab6eb26f332f for snapshot=snaptb0-testExportWithTargetName 2023-09-19 20:01:22,328 DEBUG [rs(jenkins-hbase4.apache.org,45123,1695153672695)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportWithTargetName/a978529be43650801b49b2fd94a006e7/cf/a235b37e3fa646af97ceba1a457f770b for snapshot=snaptb0-testExportWithTargetName 2023-09-19 20:01:22,355 DEBUG [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1695153680384.e6acfe578bb6e8712a5b89cd0f53982f. completed. 2023-09-19 20:01:22,355 DEBUG [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1695153680384.e6acfe578bb6e8712a5b89cd0f53982f. 2023-09-19 20:01:22,355 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-19 20:01:22,355 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-19 20:01:22,355 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:22,355 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-19 20:01:22,355 DEBUG [rs(jenkins-hbase4.apache.org,45123,1695153672695)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1695153680384.a978529be43650801b49b2fd94a006e7. completed. 2023-09-19 20:01:22,355 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,40839,1695153672784' in zk 2023-09-19 20:01:22,355 DEBUG [rs(jenkins-hbase4.apache.org,45123,1695153672695)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1695153680384.a978529be43650801b49b2fd94a006e7. 2023-09-19 20:01:22,355 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-19 20:01:22,355 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-19 20:01:22,355 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:22,355 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-19 20:01:22,355 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,45123,1695153672695' in zk 2023-09-19 20:01:22,357 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-19 20:01:22,357 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:22,357 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 20:01:22,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:22,357 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-19 20:01:22,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 20:01:22,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 20:01:22,358 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:22,359 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-19 20:01:22,359 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 20:01:22,359 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-19 20:01:22,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 20:01:22,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 20:01:22,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-19 20:01:22,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:22,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:22,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:22,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 20:01:22,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-19 20:01:22,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:22,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:22,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:22,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,40839,1695153672784': 2023-09-19 20:01:22,364 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40839,1695153672784' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-09-19 20:01:22,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:22,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 20:01:22,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 20:01:22,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 20:01:22,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 20:01:22,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-19 20:01:22,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:22,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:22,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:22,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 20:01:22,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-19 20:01:22,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:22,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:22,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:22,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,45123,1695153672695': 2023-09-19 20:01:22,368 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45123,1695153672695' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-09-19 20:01:22,368 INFO [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-09-19 20:01:22,368 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-19 20:01:22,368 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-19 20:01:22,368 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-09-19 20:01:22,368 INFO [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-19 20:01:22,371 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-19 20:01:22,371 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-19 20:01:22,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-19 20:01:22,371 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-19 20:01:22,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 20:01:22,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 20:01:22,371 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 20:01:22,371 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-19 20:01:22,371 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-19 20:01:22,372 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-19 20:01:22,372 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-19 20:01:22,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-19 20:01:22,372 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 20:01:22,372 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 20:01:22,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-19 20:01:22,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 20:01:22,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-19 20:01:22,372 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:22,372 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 20:01:22,372 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 20:01:22,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 20:01:22,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 20:01:22,373 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 20:01:22,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 20:01:22,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-19 20:01:22,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-19 20:01:22,373 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:22,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-19 20:01:22,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-19 20:01:22,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 20:01:22,374 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:22,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-19 20:01:22,374 DEBUG [Listener at jenkins-hbase4.apache.org/45213] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-19 20:01:22,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:22,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:22,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:22,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-19 20:01:22,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-19 20:01:22,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 20:01:22,376 DEBUG [Listener at jenkins-hbase4.apache.org/45213] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-09-19 20:01:22,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-19 20:01:22,377 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:22,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:22,377 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:22,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:22,378 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:22,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:22,390 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 20:01:22,390 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 20:01:22,390 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 20:01:22,390 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:22,390 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 20:01:22,390 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 20:01:22,390 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 20:01:22,390 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 20:01:22,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 20:01:22,390 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-09-19 20:01:22,390 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-19 20:01:22,390 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-09-19 20:01:22,391 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:22,390 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 20:01:22,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 20:01:22,390 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 20:01:22,390 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 20:01:22,391 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-19 20:01:22,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 20:01:22,391 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:22,392 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-19 20:01:22,392 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-19 20:01:22,392 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:22,392 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-19 20:01:22,392 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 20:01:22,392 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 20:01:22,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 20:01:22,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 20:01:22,392 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:22,392 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:22,392 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-19 20:01:22,392 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-19 20:01:22,393 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 20:01:22,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 20:01:22,394 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023091955203c36b55248e8a3830bc020725523, hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230919fa92021afd3b481d9e003661000a5db6] mob files 2023-09-19 20:01:22,394 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023091955203c36b55248e8a3830bc020725523 2023-09-19 20:01:22,394 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230919fa92021afd3b481d9e003661000a5db6 2023-09-19 20:01:22,408 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-09-19 20:01:22,409 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-19 20:01:22,443 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-09-19 20:01:22,445 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-09-19 20:01:22,445 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-19 20:01:22,445 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-19 20:01:22,445 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1695153682071Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1695153682408 (+337 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1695153682408Loading Region manifests for snaptb0-testExportWithTargetName at 1695153682409 (+1 ms)Writing data manifest for snaptb0-testExportWithTargetName at 1695153682415 (+6 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1695153682432 (+17 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1695153682445 (+13 ms) 2023-09-19 20:01:22,448 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-19 20:01:22,451 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 376 msec 2023-09-19 20:01:22,676 DEBUG [Listener at jenkins-hbase4.apache.org/45213] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-19 20:01:22,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-19 20:01:22,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-19 20:01:22,681 INFO [Listener at jenkins-hbase4.apache.org/45213] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/export-test/export-1695153682680 2023-09-19 20:01:22,681 INFO [Listener at jenkins-hbase4.apache.org/45213] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:38739, tgtDir=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/export-test/export-1695153682680, rawTgtDir=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/export-test/export-1695153682680, srcFsUri=hdfs://localhost:38739, srcDir=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf 2023-09-19 20:01:22,723 DEBUG [Listener at jenkins-hbase4.apache.org/45213] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:38739, inputRoot=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf 2023-09-19 20:01:22,723 DEBUG [Listener at jenkins-hbase4.apache.org/45213] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_197962624_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/export-test/export-1695153682680, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/export-test/export-1695153682680/.hbase-snapshot/.tmp/testExportWithTargetName 2023-09-19 20:01:22,723 INFO [Listener at jenkins-hbase4.apache.org/45213] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:38739, inputRoot=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf, snapshotDir=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-09-19 20:01:22,743 INFO [Listener at jenkins-hbase4.apache.org/45213] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/export-test/export-1695153682680/.hbase-snapshot/.tmp/testExportWithTargetName 2023-09-19 20:01:22,821 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-19 20:01:22,821 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-19 20:01:22,822 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-19 20:01:22,823 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-19 20:01:23,813 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59/hadoop-3402195612643442593.jar 2023-09-19 20:01:23,814 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-19 20:01:23,815 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-19 20:01:23,882 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59/hadoop-348295104474029761.jar 2023-09-19 20:01:23,883 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-19 20:01:23,883 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-19 20:01:23,884 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-19 20:01:23,884 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-19 20:01:23,884 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-19 20:01:23,885 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-19 20:01:23,885 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-19 20:01:23,886 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-19 20:01:23,886 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-19 20:01:23,887 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-19 20:01:23,887 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-19 20:01:23,888 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-19 20:01:23,889 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-19 20:01:23,889 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-19 20:01:23,890 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-19 20:01:23,891 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-19 20:01:23,896 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-19 20:01:23,897 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-19 20:01:23,897 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-19 20:01:23,898 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-19 20:01:23,898 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-19 20:01:23,899 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-19 20:01:23,900 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-19 20:01:24,723 WARN [Listener at jenkins-hbase4.apache.org/45213] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-19 20:01:24,729 INFO [Listener at jenkins-hbase4.apache.org/45213] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-09-19 20:01:24,737 DEBUG [Listener at jenkins-hbase4.apache.org/45213] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-09-19 20:01:25,196 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-19 20:01:25,197 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-19 20:01:25,410 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695153679175_0001_000001 (auth:SIMPLE) 2023-09-19 20:01:26,400 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-19 20:01:29,761 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695153679175_0001_000001 (auth:SIMPLE) 2023-09-19 20:01:32,009 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695153679175_0001_000001 (auth:SIMPLE) 2023-09-19 20:01:35,427 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695153679175_0001_000001 (auth:SIMPLE) 2023-09-19 20:01:36,575 INFO [Listener at jenkins-hbase4.apache.org/45213] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-19 20:01:36,578 INFO [Listener at jenkins-hbase4.apache.org/45213] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-19 20:01:36,588 INFO [Listener at jenkins-hbase4.apache.org/45213] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-09-19 20:01:36,588 INFO [Listener at jenkins-hbase4.apache.org/45213] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-19 20:01:36,589 INFO [Listener at jenkins-hbase4.apache.org/45213] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-19 20:01:36,589 DEBUG [Listener at jenkins-hbase4.apache.org/45213] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1909323301_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-09-19 20:01:36,589 DEBUG [Listener at jenkins-hbase4.apache.org/45213] snapshot.TestExportSnapshot(367): hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-09-19 20:01:36,590 DEBUG [Listener at jenkins-hbase4.apache.org/45213] snapshot.TestExportSnapshot(367): hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-09-19 20:01:36,590 DEBUG [Listener at jenkins-hbase4.apache.org/45213] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1909323301_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/export-test/export-1695153682680/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/export-test/export-1695153682680/.hbase-snapshot/testExportWithTargetName 2023-09-19 20:01:36,590 DEBUG [Listener at jenkins-hbase4.apache.org/45213] snapshot.TestExportSnapshot(367): hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/export-test/export-1695153682680/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-09-19 20:01:36,590 DEBUG [Listener at jenkins-hbase4.apache.org/45213] snapshot.TestExportSnapshot(367): hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/export-test/export-1695153682680/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-09-19 20:01:36,601 INFO [Listener at jenkins-hbase4.apache.org/45213] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-09-19 20:01:36,605 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-09-19 20:01:36,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] procedure2.ProcedureExecutor(1028): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-09-19 20:01:36,619 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695153696619"}]},"ts":"1695153696619"} 2023-09-19 20:01:36,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-19 20:01:36,621 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-09-19 20:01:36,663 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-09-19 20:01:36,665 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e6acfe578bb6e8712a5b89cd0f53982f, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a978529be43650801b49b2fd94a006e7, UNASSIGN}] 2023-09-19 20:01:36,668 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e6acfe578bb6e8712a5b89cd0f53982f, UNASSIGN 2023-09-19 20:01:36,668 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a978529be43650801b49b2fd94a006e7, UNASSIGN 2023-09-19 20:01:36,669 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=a978529be43650801b49b2fd94a006e7, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:36,669 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=e6acfe578bb6e8712a5b89cd0f53982f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:36,669 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1695153680384.a978529be43650801b49b2fd94a006e7.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695153696669"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695153696669"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695153696669"}]},"ts":"1695153696669"} 2023-09-19 20:01:36,669 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1695153680384.e6acfe578bb6e8712a5b89cd0f53982f.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695153696669"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695153696669"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695153696669"}]},"ts":"1695153696669"} 2023-09-19 20:01:36,671 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE; CloseRegionProcedure a978529be43650801b49b2fd94a006e7, server=jenkins-hbase4.apache.org,45123,1695153672695}] 2023-09-19 20:01:36,672 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=25, ppid=22, state=RUNNABLE; CloseRegionProcedure e6acfe578bb6e8712a5b89cd0f53982f, server=jenkins-hbase4.apache.org,40839,1695153672784}] 2023-09-19 20:01:36,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-19 20:01:36,832 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close a978529be43650801b49b2fd94a006e7 2023-09-19 20:01:36,832 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e6acfe578bb6e8712a5b89cd0f53982f 2023-09-19 20:01:36,833 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a978529be43650801b49b2fd94a006e7, disabling compactions & flushes 2023-09-19 20:01:36,833 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e6acfe578bb6e8712a5b89cd0f53982f, disabling compactions & flushes 2023-09-19 20:01:36,833 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1695153680384.a978529be43650801b49b2fd94a006e7. 2023-09-19 20:01:36,833 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1695153680384.e6acfe578bb6e8712a5b89cd0f53982f. 2023-09-19 20:01:36,833 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1695153680384.a978529be43650801b49b2fd94a006e7. 2023-09-19 20:01:36,833 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1695153680384.a978529be43650801b49b2fd94a006e7. after waiting 0 ms 2023-09-19 20:01:36,833 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1695153680384.a978529be43650801b49b2fd94a006e7. 2023-09-19 20:01:36,833 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1695153680384.e6acfe578bb6e8712a5b89cd0f53982f. 2023-09-19 20:01:36,833 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1695153680384.e6acfe578bb6e8712a5b89cd0f53982f. after waiting 0 ms 2023-09-19 20:01:36,833 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1695153680384.e6acfe578bb6e8712a5b89cd0f53982f. 2023-09-19 20:01:36,851 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportWithTargetName/a978529be43650801b49b2fd94a006e7/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-19 20:01:36,851 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportWithTargetName/e6acfe578bb6e8712a5b89cd0f53982f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-19 20:01:36,852 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-19 20:01:36,852 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-19 20:01:36,853 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1695153680384.a978529be43650801b49b2fd94a006e7. 2023-09-19 20:01:36,853 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1695153680384.e6acfe578bb6e8712a5b89cd0f53982f. 2023-09-19 20:01:36,853 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a978529be43650801b49b2fd94a006e7: 2023-09-19 20:01:36,853 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e6acfe578bb6e8712a5b89cd0f53982f: 2023-09-19 20:01:36,856 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e6acfe578bb6e8712a5b89cd0f53982f 2023-09-19 20:01:36,857 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=e6acfe578bb6e8712a5b89cd0f53982f, regionState=CLOSED 2023-09-19 20:01:36,857 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1695153680384.e6acfe578bb6e8712a5b89cd0f53982f.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695153696857"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695153696857"}]},"ts":"1695153696857"} 2023-09-19 20:01:36,858 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed a978529be43650801b49b2fd94a006e7 2023-09-19 20:01:36,859 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=a978529be43650801b49b2fd94a006e7, regionState=CLOSED 2023-09-19 20:01:36,859 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1695153680384.a978529be43650801b49b2fd94a006e7.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695153696859"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695153696859"}]},"ts":"1695153696859"} 2023-09-19 20:01:36,863 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=25, resume processing ppid=22 2023-09-19 20:01:36,863 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=25, ppid=22, state=SUCCESS; CloseRegionProcedure e6acfe578bb6e8712a5b89cd0f53982f, server=jenkins-hbase4.apache.org,40839,1695153672784 in 188 msec 2023-09-19 20:01:36,866 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=24, resume processing ppid=23 2023-09-19 20:01:36,866 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=24, ppid=23, state=SUCCESS; CloseRegionProcedure a978529be43650801b49b2fd94a006e7, server=jenkins-hbase4.apache.org,45123,1695153672695 in 191 msec 2023-09-19 20:01:36,867 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e6acfe578bb6e8712a5b89cd0f53982f, UNASSIGN in 198 msec 2023-09-19 20:01:36,869 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=23, resume processing ppid=21 2023-09-19 20:01:36,869 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a978529be43650801b49b2fd94a006e7, UNASSIGN in 201 msec 2023-09-19 20:01:36,871 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695153696870"}]},"ts":"1695153696870"} 2023-09-19 20:01:36,872 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-09-19 20:01:36,885 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-09-19 20:01:36,888 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 278 msec 2023-09-19 20:01:36,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-19 20:01:36,924 INFO [Listener at jenkins-hbase4.apache.org/45213] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-09-19 20:01:36,929 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-09-19 20:01:36,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] procedure2.ProcedureExecutor(1028): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-19 20:01:36,941 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-19 20:01:36,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-09-19 20:01:36,944 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-19 20:01:36,947 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40839] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-09-19 20:01:36,949 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportWithTargetName/e6acfe578bb6e8712a5b89cd0f53982f 2023-09-19 20:01:36,950 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportWithTargetName/a978529be43650801b49b2fd94a006e7 2023-09-19 20:01:36,953 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportWithTargetName/e6acfe578bb6e8712a5b89cd0f53982f/cf, FileablePath, hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportWithTargetName/e6acfe578bb6e8712a5b89cd0f53982f/recovered.edits] 2023-09-19 20:01:36,953 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportWithTargetName/a978529be43650801b49b2fd94a006e7/cf, FileablePath, hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportWithTargetName/a978529be43650801b49b2fd94a006e7/recovered.edits] 2023-09-19 20:01:36,961 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportWithTargetName/e6acfe578bb6e8712a5b89cd0f53982f/cf/8defc9b68f6f47838a38ab6eb26f332f to hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/archive/data/default/testtb-testExportWithTargetName/e6acfe578bb6e8712a5b89cd0f53982f/cf/8defc9b68f6f47838a38ab6eb26f332f 2023-09-19 20:01:36,961 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportWithTargetName/a978529be43650801b49b2fd94a006e7/cf/a235b37e3fa646af97ceba1a457f770b to hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/archive/data/default/testtb-testExportWithTargetName/a978529be43650801b49b2fd94a006e7/cf/a235b37e3fa646af97ceba1a457f770b 2023-09-19 20:01:36,965 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportWithTargetName/e6acfe578bb6e8712a5b89cd0f53982f/recovered.edits/9.seqid to hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/archive/data/default/testtb-testExportWithTargetName/e6acfe578bb6e8712a5b89cd0f53982f/recovered.edits/9.seqid 2023-09-19 20:01:36,966 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportWithTargetName/a978529be43650801b49b2fd94a006e7/recovered.edits/9.seqid to hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/archive/data/default/testtb-testExportWithTargetName/a978529be43650801b49b2fd94a006e7/recovered.edits/9.seqid 2023-09-19 20:01:36,966 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportWithTargetName/e6acfe578bb6e8712a5b89cd0f53982f 2023-09-19 20:01:36,966 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportWithTargetName/a978529be43650801b49b2fd94a006e7 2023-09-19 20:01:36,966 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-09-19 20:01:36,967 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-09-19 20:01:36,968 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-09-19 20:01:36,973 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023091955203c36b55248e8a3830bc020725523 to hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023091955203c36b55248e8a3830bc020725523 2023-09-19 20:01:36,974 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230919fa92021afd3b481d9e003661000a5db6 to hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230919fa92021afd3b481d9e003661000a5db6 2023-09-19 20:01:36,975 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-09-19 20:01:36,978 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-19 20:01:36,993 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-19 20:01:36,995 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-19 20:01:36,993 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-19 20:01:36,993 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-19 20:01:37,002 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-09-19 20:01:37,005 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-09-19 20:01:37,007 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-19 20:01:37,007 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-09-19 20:01:37,007 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1695153680384.e6acfe578bb6e8712a5b89cd0f53982f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695153697007"}]},"ts":"9223372036854775807"} 2023-09-19 20:01:37,007 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1695153680384.a978529be43650801b49b2fd94a006e7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695153697007"}]},"ts":"9223372036854775807"} 2023-09-19 20:01:37,009 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 20:01:37,009 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 20:01:37,009 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-19 20:01:37,009 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 20:01:37,009 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 20:01:37,009 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-19 20:01:37,009 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-19 20:01:37,009 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-19 20:01:37,009 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-19 20:01:37,009 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-19 20:01:37,009 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-19 20:01:37,010 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-19 20:01:37,010 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-19 20:01:37,010 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => e6acfe578bb6e8712a5b89cd0f53982f, NAME => 'testtb-testExportWithTargetName,,1695153680384.e6acfe578bb6e8712a5b89cd0f53982f.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => a978529be43650801b49b2fd94a006e7, NAME => 'testtb-testExportWithTargetName,1,1695153680384.a978529be43650801b49b2fd94a006e7.', STARTKEY => '1', ENDKEY => ''}] 2023-09-19 20:01:37,010 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-09-19 20:01:37,010 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695153697010"}]},"ts":"9223372036854775807"} 2023-09-19 20:01:37,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-09-19 20:01:37,013 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-09-19 20:01:37,017 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-19 20:01:37,019 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 86 msec 2023-09-19 20:01:37,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-09-19 20:01:37,114 INFO [Listener at jenkins-hbase4.apache.org/45213] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-09-19 20:01:37,134 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-09-19 20:01:37,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-09-19 20:01:37,140 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-09-19 20:01:37,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-09-19 20:01:37,173 INFO [Listener at jenkins-hbase4.apache.org/45213] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=755 (was 706) Potentially hanging thread: hconnection-0x51b5961f-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1909323301_17 at /127.0.0.1:32872 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1281 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1909323301_17 at /127.0.0.1:33790 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1781244183) connection to jenkins-hbase4.apache.org/172.31.14.131:45213 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59/cluster_89d21045-e502-a291-a4eb-07ce7438eb28/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x51b5961f-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59/cluster_89d21045-e502-a291-a4eb-07ce7438eb28/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1781244183) connection to jenkins-hbase4.apache.org/172.31.14.131:42817 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1061711416_1 at /127.0.0.1:34122 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59/cluster_89d21045-e502-a291-a4eb-07ce7438eb28/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59/cluster_89d21045-e502-a291-a4eb-07ce7438eb28/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59/cluster_89d21045-e502-a291-a4eb-07ce7438eb28/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x51b5961f-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1781244183) connection to jenkins-hbase4.apache.org/172.31.14.131:35899 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59/cluster_89d21045-e502-a291-a4eb-07ce7438eb28/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x51b5961f-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1909323301_17 at /127.0.0.1:34152 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1781244183) connection to jenkins-hbase4.apache.org/172.31.14.131:38111 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=935 (was 899) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=195 (was 147) - SystemLoadAverage LEAK? -, ProcessCount=169 (was 165) - ProcessCount LEAK? -, AvailableMemoryMB=7955 (was 8763) 2023-09-19 20:01:37,173 WARN [Listener at jenkins-hbase4.apache.org/45213] hbase.ResourceChecker(130): Thread=755 is superior to 500 2023-09-19 20:01:37,192 INFO [Listener at jenkins-hbase4.apache.org/45213] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=755, OpenFileDescriptor=935, MaxFileDescriptor=60000, SystemLoadAverage=195, ProcessCount=169, AvailableMemoryMB=7954 2023-09-19 20:01:37,192 WARN [Listener at jenkins-hbase4.apache.org/45213] hbase.ResourceChecker(130): Thread=755 is superior to 500 2023-09-19 20:01:37,194 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-19 20:01:37,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] procedure2.ProcedureExecutor(1028): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-09-19 20:01:37,199 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-09-19 20:01:37,200 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-09-19 20:01:37,201 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-19 20:01:37,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-19 20:01:37,204 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportFileSystemState/bd6db4e2e4e461b731249d855cd45af2 2023-09-19 20:01:37,204 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportFileSystemState/87a6398e108aad5b1b4af23cabfb21bb 2023-09-19 20:01:37,204 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportFileSystemState/bd6db4e2e4e461b731249d855cd45af2 empty. 2023-09-19 20:01:37,204 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportFileSystemState/87a6398e108aad5b1b4af23cabfb21bb empty. 2023-09-19 20:01:37,205 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportFileSystemState/bd6db4e2e4e461b731249d855cd45af2 2023-09-19 20:01:37,205 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportFileSystemState/87a6398e108aad5b1b4af23cabfb21bb 2023-09-19 20:01:37,205 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-09-19 20:01:37,216 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-09-19 20:01:37,218 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 87a6398e108aad5b1b4af23cabfb21bb, NAME => 'testtb-testExportFileSystemState,1,1695153697194.87a6398e108aad5b1b4af23cabfb21bb.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp 2023-09-19 20:01:37,218 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => bd6db4e2e4e461b731249d855cd45af2, NAME => 'testtb-testExportFileSystemState,,1695153697194.bd6db4e2e4e461b731249d855cd45af2.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp 2023-09-19 20:01:37,237 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1695153697194.87a6398e108aad5b1b4af23cabfb21bb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 20:01:37,238 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 87a6398e108aad5b1b4af23cabfb21bb, disabling compactions & flushes 2023-09-19 20:01:37,238 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1695153697194.87a6398e108aad5b1b4af23cabfb21bb. 2023-09-19 20:01:37,238 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1695153697194.87a6398e108aad5b1b4af23cabfb21bb. 2023-09-19 20:01:37,238 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1695153697194.87a6398e108aad5b1b4af23cabfb21bb. after waiting 0 ms 2023-09-19 20:01:37,238 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1695153697194.87a6398e108aad5b1b4af23cabfb21bb. 2023-09-19 20:01:37,238 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1695153697194.87a6398e108aad5b1b4af23cabfb21bb. 2023-09-19 20:01:37,238 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 87a6398e108aad5b1b4af23cabfb21bb: 2023-09-19 20:01:37,239 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1695153697194.bd6db4e2e4e461b731249d855cd45af2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 20:01:37,240 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing bd6db4e2e4e461b731249d855cd45af2, disabling compactions & flushes 2023-09-19 20:01:37,240 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1695153697194.bd6db4e2e4e461b731249d855cd45af2. 2023-09-19 20:01:37,240 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1695153697194.bd6db4e2e4e461b731249d855cd45af2. 2023-09-19 20:01:37,240 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1695153697194.bd6db4e2e4e461b731249d855cd45af2. after waiting 0 ms 2023-09-19 20:01:37,240 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1695153697194.bd6db4e2e4e461b731249d855cd45af2. 2023-09-19 20:01:37,240 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1695153697194.bd6db4e2e4e461b731249d855cd45af2. 2023-09-19 20:01:37,240 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for bd6db4e2e4e461b731249d855cd45af2: 2023-09-19 20:01:37,243 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-09-19 20:01:37,244 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1695153697194.87a6398e108aad5b1b4af23cabfb21bb.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695153697244"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695153697244"}]},"ts":"1695153697244"} 2023-09-19 20:01:37,244 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1695153697194.bd6db4e2e4e461b731249d855cd45af2.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695153697244"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695153697244"}]},"ts":"1695153697244"} 2023-09-19 20:01:37,247 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-19 20:01:37,248 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-19 20:01:37,248 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695153697248"}]},"ts":"1695153697248"} 2023-09-19 20:01:37,250 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-09-19 20:01:37,254 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-19 20:01:37,258 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-19 20:01:37,258 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-19 20:01:37,258 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-19 20:01:37,258 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-19 20:01:37,258 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=bd6db4e2e4e461b731249d855cd45af2, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=87a6398e108aad5b1b4af23cabfb21bb, ASSIGN}] 2023-09-19 20:01:37,261 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=87a6398e108aad5b1b4af23cabfb21bb, ASSIGN 2023-09-19 20:01:37,261 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=bd6db4e2e4e461b731249d855cd45af2, ASSIGN 2023-09-19 20:01:37,262 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=87a6398e108aad5b1b4af23cabfb21bb, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45123,1695153672695; forceNewPlan=false, retain=false 2023-09-19 20:01:37,262 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=bd6db4e2e4e461b731249d855cd45af2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40397,1695153672742; forceNewPlan=false, retain=false 2023-09-19 20:01:37,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-19 20:01:37,412 INFO [jenkins-hbase4:37929] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-19 20:01:37,416 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=87a6398e108aad5b1b4af23cabfb21bb, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:37,416 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=bd6db4e2e4e461b731249d855cd45af2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:37,416 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1695153697194.87a6398e108aad5b1b4af23cabfb21bb.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695153697415"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695153697415"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695153697415"}]},"ts":"1695153697415"} 2023-09-19 20:01:37,416 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1695153697194.bd6db4e2e4e461b731249d855cd45af2.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695153697415"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695153697415"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695153697415"}]},"ts":"1695153697415"} 2023-09-19 20:01:37,418 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE; OpenRegionProcedure 87a6398e108aad5b1b4af23cabfb21bb, server=jenkins-hbase4.apache.org,45123,1695153672695}] 2023-09-19 20:01:37,419 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure bd6db4e2e4e461b731249d855cd45af2, server=jenkins-hbase4.apache.org,40397,1695153672742}] 2023-09-19 20:01:37,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-19 20:01:37,579 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1695153697194.87a6398e108aad5b1b4af23cabfb21bb. 2023-09-19 20:01:37,579 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 87a6398e108aad5b1b4af23cabfb21bb, NAME => 'testtb-testExportFileSystemState,1,1695153697194.87a6398e108aad5b1b4af23cabfb21bb.', STARTKEY => '1', ENDKEY => ''} 2023-09-19 20:01:37,579 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1695153697194.87a6398e108aad5b1b4af23cabfb21bb. service=AccessControlService 2023-09-19 20:01:37,579 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-19 20:01:37,580 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 87a6398e108aad5b1b4af23cabfb21bb 2023-09-19 20:01:37,580 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1695153697194.87a6398e108aad5b1b4af23cabfb21bb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 20:01:37,580 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1695153697194.bd6db4e2e4e461b731249d855cd45af2. 2023-09-19 20:01:37,580 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 87a6398e108aad5b1b4af23cabfb21bb 2023-09-19 20:01:37,580 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 87a6398e108aad5b1b4af23cabfb21bb 2023-09-19 20:01:37,580 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => bd6db4e2e4e461b731249d855cd45af2, NAME => 'testtb-testExportFileSystemState,,1695153697194.bd6db4e2e4e461b731249d855cd45af2.', STARTKEY => '', ENDKEY => '1'} 2023-09-19 20:01:37,581 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1695153697194.bd6db4e2e4e461b731249d855cd45af2. service=AccessControlService 2023-09-19 20:01:37,581 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-19 20:01:37,581 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState bd6db4e2e4e461b731249d855cd45af2 2023-09-19 20:01:37,581 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1695153697194.bd6db4e2e4e461b731249d855cd45af2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 20:01:37,581 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for bd6db4e2e4e461b731249d855cd45af2 2023-09-19 20:01:37,581 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for bd6db4e2e4e461b731249d855cd45af2 2023-09-19 20:01:37,581 INFO [StoreOpener-87a6398e108aad5b1b4af23cabfb21bb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 87a6398e108aad5b1b4af23cabfb21bb 2023-09-19 20:01:37,582 INFO [StoreOpener-bd6db4e2e4e461b731249d855cd45af2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region bd6db4e2e4e461b731249d855cd45af2 2023-09-19 20:01:37,583 DEBUG [StoreOpener-87a6398e108aad5b1b4af23cabfb21bb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemState/87a6398e108aad5b1b4af23cabfb21bb/cf 2023-09-19 20:01:37,583 DEBUG [StoreOpener-87a6398e108aad5b1b4af23cabfb21bb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemState/87a6398e108aad5b1b4af23cabfb21bb/cf 2023-09-19 20:01:37,583 INFO [StoreOpener-87a6398e108aad5b1b4af23cabfb21bb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 87a6398e108aad5b1b4af23cabfb21bb columnFamilyName cf 2023-09-19 20:01:37,584 DEBUG [StoreOpener-bd6db4e2e4e461b731249d855cd45af2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemState/bd6db4e2e4e461b731249d855cd45af2/cf 2023-09-19 20:01:37,584 DEBUG [StoreOpener-bd6db4e2e4e461b731249d855cd45af2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemState/bd6db4e2e4e461b731249d855cd45af2/cf 2023-09-19 20:01:37,584 INFO [StoreOpener-bd6db4e2e4e461b731249d855cd45af2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bd6db4e2e4e461b731249d855cd45af2 columnFamilyName cf 2023-09-19 20:01:37,585 INFO [StoreOpener-87a6398e108aad5b1b4af23cabfb21bb-1] regionserver.HStore(310): Store=87a6398e108aad5b1b4af23cabfb21bb/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-19 20:01:37,587 INFO [StoreOpener-bd6db4e2e4e461b731249d855cd45af2-1] regionserver.HStore(310): Store=bd6db4e2e4e461b731249d855cd45af2/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-19 20:01:37,588 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemState/87a6398e108aad5b1b4af23cabfb21bb 2023-09-19 20:01:37,588 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemState/87a6398e108aad5b1b4af23cabfb21bb 2023-09-19 20:01:37,589 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemState/bd6db4e2e4e461b731249d855cd45af2 2023-09-19 20:01:37,589 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemState/bd6db4e2e4e461b731249d855cd45af2 2023-09-19 20:01:37,591 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 87a6398e108aad5b1b4af23cabfb21bb 2023-09-19 20:01:37,592 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for bd6db4e2e4e461b731249d855cd45af2 2023-09-19 20:01:37,594 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemState/87a6398e108aad5b1b4af23cabfb21bb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-19 20:01:37,594 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 87a6398e108aad5b1b4af23cabfb21bb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75419671, jitterRate=0.12384067475795746}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-19 20:01:37,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 87a6398e108aad5b1b4af23cabfb21bb: 2023-09-19 20:01:37,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemState/bd6db4e2e4e461b731249d855cd45af2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-19 20:01:37,596 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1695153697194.87a6398e108aad5b1b4af23cabfb21bb., pid=30, masterSystemTime=1695153697571 2023-09-19 20:01:37,596 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened bd6db4e2e4e461b731249d855cd45af2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62454423, jitterRate=-0.06935657560825348}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-19 20:01:37,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for bd6db4e2e4e461b731249d855cd45af2: 2023-09-19 20:01:37,597 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1695153697194.bd6db4e2e4e461b731249d855cd45af2., pid=31, masterSystemTime=1695153697572 2023-09-19 20:01:37,598 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1695153697194.87a6398e108aad5b1b4af23cabfb21bb. 2023-09-19 20:01:37,598 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1695153697194.87a6398e108aad5b1b4af23cabfb21bb. 2023-09-19 20:01:37,599 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=87a6398e108aad5b1b4af23cabfb21bb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:37,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1695153697194.bd6db4e2e4e461b731249d855cd45af2. 2023-09-19 20:01:37,599 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1695153697194.bd6db4e2e4e461b731249d855cd45af2. 2023-09-19 20:01:37,599 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1695153697194.87a6398e108aad5b1b4af23cabfb21bb.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695153697599"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695153697599"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695153697599"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695153697599"}]},"ts":"1695153697599"} 2023-09-19 20:01:37,600 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=bd6db4e2e4e461b731249d855cd45af2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:37,600 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1695153697194.bd6db4e2e4e461b731249d855cd45af2.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695153697600"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695153697600"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695153697600"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695153697600"}]},"ts":"1695153697600"} 2023-09-19 20:01:37,604 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=30, resume processing ppid=29 2023-09-19 20:01:37,605 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=30, ppid=29, state=SUCCESS; OpenRegionProcedure 87a6398e108aad5b1b4af23cabfb21bb, server=jenkins-hbase4.apache.org,45123,1695153672695 in 183 msec 2023-09-19 20:01:37,607 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=31, resume processing ppid=28 2023-09-19 20:01:37,610 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure bd6db4e2e4e461b731249d855cd45af2, server=jenkins-hbase4.apache.org,40397,1695153672742 in 183 msec 2023-09-19 20:01:37,611 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=87a6398e108aad5b1b4af23cabfb21bb, ASSIGN in 347 msec 2023-09-19 20:01:37,612 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=28, resume processing ppid=27 2023-09-19 20:01:37,613 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=bd6db4e2e4e461b731249d855cd45af2, ASSIGN in 352 msec 2023-09-19 20:01:37,613 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-19 20:01:37,614 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695153697613"}]},"ts":"1695153697613"} 2023-09-19 20:01:37,615 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-09-19 20:01:37,618 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-09-19 20:01:37,618 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-09-19 20:01:37,620 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40839] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-19 20:01:37,621 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 20:01:37,621 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 20:01:37,621 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 20:01:37,621 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 20:01:37,624 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-19 20:01:37,624 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-19 20:01:37,624 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-19 20:01:37,624 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-19 20:01:37,626 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 429 msec 2023-09-19 20:01:37,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-19 20:01:37,806 INFO [Listener at jenkins-hbase4.apache.org/45213] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-09-19 20:01:37,809 DEBUG [Listener at jenkins-hbase4.apache.org/45213] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-09-19 20:01:37,809 DEBUG [Listener at jenkins-hbase4.apache.org/45213] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1695153697194.bd6db4e2e4e461b731249d855cd45af2. 2023-09-19 20:01:37,811 INFO [Listener at jenkins-hbase4.apache.org/45213] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-19 20:01:37,820 DEBUG [hconnection-0x5a782b32-shared-pool-10] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 20:01:37,824 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54072, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 20:01:37,830 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-19 20:01:37,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695153697830 (current time:1695153697830). 2023-09-19 20:01:37,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-19 20:01:37,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] zookeeper.ReadOnlyZKClient(139): Connect 0x41040aa3 to 127.0.0.1:60323 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-19 20:01:37,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1e00a1f0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-19 20:01:37,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 20:01:37,842 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45264, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 20:01:37,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x41040aa3 to 127.0.0.1:60323 2023-09-19 20:01:37,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 20:01:37,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] zookeeper.ReadOnlyZKClient(139): Connect 0x49a4b75d to 127.0.0.1:60323 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-19 20:01:37,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2894edd8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-19 20:01:37,853 DEBUG [hconnection-0x3300d61b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 20:01:37,855 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45278, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 20:01:37,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 20:01:37,862 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35106, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 20:01:37,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x49a4b75d to 127.0.0.1:60323 2023-09-19 20:01:37,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 20:01:37,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-19 20:01:37,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-19 20:01:37,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-19 20:01:37,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] procedure2.ProcedureExecutor(1028): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-19 20:01:37,868 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-19 20:01:37,869 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695154297869 2023-09-19 20:01:37,869 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-09-19 20:01:37,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-19 20:01:37,871 DEBUG [Listener at jenkins-hbase4.apache.org/45213] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-19 20:01:37,871 DEBUG [Listener at jenkins-hbase4.apache.org/45213] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-19 20:01:37,872 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-19 20:01:37,872 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-19 20:01:37,875 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-09-19 20:01:37,876 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-19 20:01:37,877 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695154297877 2023-09-19 20:01:37,896 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-09-19 20:01:37,896 INFO [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-09-19 20:01:37,896 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 20:01:37,897 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-09-19 20:01:37,897 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-09-19 20:01:37,898 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-19 20:01:37,898 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-19 20:01:37,899 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 20:01:37,899 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 20:01:37,899 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 20:01:37,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 20:01:37,899 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 20:01:37,899 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:37,900 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 20:01:37,899 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 20:01:37,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 20:01:37,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 20:01:37,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-19 20:01:37,900 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:37,900 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:37,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-19 20:01:37,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-19 20:01:37,901 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-19 20:01:37,901 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:37,901 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-19 20:01:37,901 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-19 20:01:37,901 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-19 20:01:37,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-19 20:01:37,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-19 20:01:37,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-19 20:01:37,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-19 20:01:37,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-19 20:01:37,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-19 20:01:37,901 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-19 20:01:37,902 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-19 20:01:37,902 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-19 20:01:37,902 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-19 20:01:37,902 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-19 20:01:37,902 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-19 20:01:37,902 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-19 20:01:37,902 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-19 20:01:37,902 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 20:01:37,902 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-19 20:01:37,903 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-19 20:01:37,904 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-19 20:01:37,904 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40397,1695153672742' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-19 20:01:37,902 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 20:01:37,903 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 20:01:37,905 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-19 20:01:37,906 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-19 20:01:37,906 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-19 20:01:37,906 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-19 20:01:37,906 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40839,1695153672784' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-19 20:01:37,906 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45123,1695153672695' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-19 20:01:37,907 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-19 20:01:37,907 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:37,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:37,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 20:01:37,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 20:01:37,914 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-19 20:01:37,914 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-19 20:01:37,914 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-19 20:01:37,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 20:01:37,914 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-19 20:01:37,915 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 20:01:37,914 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:37,915 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-19 20:01:37,915 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 20:01:37,915 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 20:01:37,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 20:01:37,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-19 20:01:37,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:37,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:37,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:37,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 20:01:37,917 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40397,1695153672742' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-09-19 20:01:37,917 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3de6d5c4[Count = 1] remaining members to acquire global barrier 2023-09-19 20:01:37,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:37,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 20:01:37,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 20:01:37,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 20:01:37,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 20:01:37,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-19 20:01:37,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:37,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:37,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:37,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 20:01:37,919 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45123,1695153672695' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-09-19 20:01:37,919 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3de6d5c4[Count = 0] remaining members to acquire global barrier 2023-09-19 20:01:37,919 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-09-19 20:01:37,919 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-19 20:01:37,921 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-19 20:01:37,921 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-19 20:01:37,921 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-19 20:01:37,921 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-19 20:01:37,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-19 20:01:37,921 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-19 20:01:37,921 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:37,921 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-19 20:01:37,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-19 20:01:37,921 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-19 20:01:37,921 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-19 20:01:37,921 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-19 20:01:37,921 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40839,1695153672784' in zk 2023-09-19 20:01:37,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-19 20:01:37,922 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-19 20:01:37,922 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:37,922 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-19 20:01:37,922 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-19 20:01:37,922 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-19 20:01:37,922 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-19 20:01:37,922 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-19 20:01:37,922 DEBUG [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1695153697194.bd6db4e2e4e461b731249d855cd45af2. 2023-09-19 20:01:37,922 DEBUG [rs(jenkins-hbase4.apache.org,45123,1695153672695)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1695153697194.87a6398e108aad5b1b4af23cabfb21bb. 2023-09-19 20:01:37,922 DEBUG [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1695153697194.bd6db4e2e4e461b731249d855cd45af2. started... 2023-09-19 20:01:37,922 DEBUG [rs(jenkins-hbase4.apache.org,45123,1695153672695)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1695153697194.87a6398e108aad5b1b4af23cabfb21bb. started... 2023-09-19 20:01:37,924 DEBUG [rs(jenkins-hbase4.apache.org,45123,1695153672695)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 87a6398e108aad5b1b4af23cabfb21bb: 2023-09-19 20:01:37,924 DEBUG [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for bd6db4e2e4e461b731249d855cd45af2: 2023-09-19 20:01:37,924 DEBUG [rs(jenkins-hbase4.apache.org,45123,1695153672695)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1695153697194.87a6398e108aad5b1b4af23cabfb21bb.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-19 20:01:37,924 DEBUG [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1695153697194.bd6db4e2e4e461b731249d855cd45af2.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-19 20:01:37,924 DEBUG [rs(jenkins-hbase4.apache.org,45123,1695153672695)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-19 20:01:37,924 DEBUG [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-19 20:01:37,924 DEBUG [rs(jenkins-hbase4.apache.org,45123,1695153672695)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-19 20:01:37,924 DEBUG [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-19 20:01:37,928 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-19 20:01:37,928 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 20:01:37,928 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-19 20:01:37,971 DEBUG [Listener at jenkins-hbase4.apache.org/45213] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-19 20:01:37,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-19 20:01:37,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-19 20:01:37,973 DEBUG [Listener at jenkins-hbase4.apache.org/45213] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-19 20:01:38,173 DEBUG [Listener at jenkins-hbase4.apache.org/45213] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-19 20:01:38,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-19 20:01:38,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-19 20:01:38,174 DEBUG [Listener at jenkins-hbase4.apache.org/45213] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-09-19 20:01:38,348 DEBUG [rs(jenkins-hbase4.apache.org,45123,1695153672695)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1695153697194.87a6398e108aad5b1b4af23cabfb21bb. completed. 2023-09-19 20:01:38,348 DEBUG [rs(jenkins-hbase4.apache.org,45123,1695153672695)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1695153697194.87a6398e108aad5b1b4af23cabfb21bb. 2023-09-19 20:01:38,348 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-19 20:01:38,348 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-19 20:01:38,348 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:38,348 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-19 20:01:38,348 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45123,1695153672695' in zk 2023-09-19 20:01:38,348 DEBUG [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1695153697194.bd6db4e2e4e461b731249d855cd45af2. completed. 2023-09-19 20:01:38,349 DEBUG [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1695153697194.bd6db4e2e4e461b731249d855cd45af2. 2023-09-19 20:01:38,349 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-19 20:01:38,349 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-19 20:01:38,349 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:38,349 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-19 20:01:38,349 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40397,1695153672742' in zk 2023-09-19 20:01:38,350 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:38,350 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-19 20:01:38,350 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 20:01:38,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:38,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 20:01:38,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 20:01:38,350 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-19 20:01:38,353 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:38,353 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-19 20:01:38,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 20:01:38,353 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 20:01:38,353 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-19 20:01:38,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 20:01:38,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-19 20:01:38,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:38,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:38,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:38,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 20:01:38,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-19 20:01:38,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:38,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:38,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:38,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,45123,1695153672695': 2023-09-19 20:01:38,358 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45123,1695153672695' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-19 20:01:38,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:38,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 20:01:38,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 20:01:38,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 20:01:38,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 20:01:38,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-19 20:01:38,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:38,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:38,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:38,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 20:01:38,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-19 20:01:38,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:38,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:38,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:38,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,40397,1695153672742': 2023-09-19 20:01:38,362 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40397,1695153672742' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-19 20:01:38,362 INFO [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-09-19 20:01:38,362 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-19 20:01:38,362 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-19 20:01:38,362 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-09-19 20:01:38,362 INFO [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-19 20:01:38,364 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-19 20:01:38,364 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-19 20:01:38,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-19 20:01:38,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-19 20:01:38,364 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 20:01:38,364 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-19 20:01:38,364 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 20:01:38,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-19 20:01:38,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 20:01:38,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 20:01:38,364 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-19 20:01:38,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-19 20:01:38,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-19 20:01:38,365 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:38,365 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-19 20:01:38,365 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 20:01:38,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-19 20:01:38,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 20:01:38,365 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 20:01:38,365 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 20:01:38,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 20:01:38,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 20:01:38,366 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:38,366 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 20:01:38,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 20:01:38,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-19 20:01:38,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-19 20:01:38,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-19 20:01:38,366 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:38,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-19 20:01:38,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 20:01:38,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-19 20:01:38,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:38,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:38,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:38,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 20:01:38,369 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:38,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-19 20:01:38,369 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:38,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:38,369 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:38,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:38,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:38,374 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:38,374 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-19 20:01:38,374 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 20:01:38,374 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 20:01:38,374 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 20:01:38,374 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 20:01:38,374 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 20:01:38,374 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 20:01:38,374 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 20:01:38,374 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:38,375 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 20:01:38,375 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:38,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 20:01:38,376 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-19 20:01:38,374 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-09-19 20:01:38,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 20:01:38,376 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-09-19 20:01:38,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 20:01:38,374 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 20:01:38,376 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-19 20:01:38,376 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:38,376 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-19 20:01:38,376 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 20:01:38,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 20:01:38,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 20:01:38,376 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-19 20:01:38,376 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 20:01:38,376 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:38,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 20:01:38,376 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:38,377 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-19 20:01:38,377 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-19 20:01:38,377 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 20:01:38,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 20:01:38,377 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-19 20:01:38,390 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-09-19 20:01:38,392 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-19 20:01:38,416 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-09-19 20:01:38,417 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-09-19 20:01:38,417 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-19 20:01:38,418 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-19 20:01:38,418 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1695153697870Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1695153698390 (+520 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1695153698390Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1695153698391 (+1 ms)Writing data manifest for emptySnaptb0-testExportFileSystemState at 1695153698398 (+7 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1695153698408 (+10 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1695153698417 (+9 ms) 2023-09-19 20:01:38,420 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-19 20:01:38,423 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 549 msec 2023-09-19 20:01:38,475 DEBUG [Listener at jenkins-hbase4.apache.org/45213] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-19 20:01:38,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-19 20:01:38,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-19 20:01:38,481 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40397] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1695153697194.bd6db4e2e4e461b731249d855cd45af2. with WAL disabled. Data may be lost in the event of a crash. 2023-09-19 20:01:38,482 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45123] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1695153697194.87a6398e108aad5b1b4af23cabfb21bb. with WAL disabled. Data may be lost in the event of a crash. 2023-09-19 20:01:38,486 DEBUG [Listener at jenkins-hbase4.apache.org/45213] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-09-19 20:01:38,486 DEBUG [Listener at jenkins-hbase4.apache.org/45213] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1695153697194.bd6db4e2e4e461b731249d855cd45af2. 2023-09-19 20:01:38,487 INFO [Listener at jenkins-hbase4.apache.org/45213] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-19 20:01:38,499 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-19 20:01:38,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695153698499 (current time:1695153698499). 2023-09-19 20:01:38,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-19 20:01:38,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] zookeeper.ReadOnlyZKClient(139): Connect 0x1244686b to 127.0.0.1:60323 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-19 20:01:38,507 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-09-19 20:01:38,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@64bbc2fd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-19 20:01:38,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 20:01:38,514 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45290, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 20:01:38,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1244686b to 127.0.0.1:60323 2023-09-19 20:01:38,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 20:01:38,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] zookeeper.ReadOnlyZKClient(139): Connect 0x45f87b53 to 127.0.0.1:60323 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-19 20:01:38,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4ed8dce9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-19 20:01:38,525 DEBUG [hconnection-0x9fb57c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 20:01:38,526 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45302, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 20:01:38,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 20:01:38,534 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35112, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 20:01:38,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x45f87b53 to 127.0.0.1:60323 2023-09-19 20:01:38,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 20:01:38,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-19 20:01:38,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-19 20:01:38,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-19 20:01:38,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] procedure2.ProcedureExecutor(1028): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-19 20:01:38,540 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-19 20:01:38,541 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695154298541 2023-09-19 20:01:38,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-19 20:01:38,541 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-09-19 20:01:38,543 DEBUG [Listener at jenkins-hbase4.apache.org/45213] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-19 20:01:38,543 DEBUG [Listener at jenkins-hbase4.apache.org/45213] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-19 20:01:38,544 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-19 20:01:38,544 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-19 20:01:38,545 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-09-19 20:01:38,546 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-19 20:01:38,547 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695154298547 2023-09-19 20:01:38,561 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-09-19 20:01:38,561 INFO [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-09-19 20:01:38,561 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 20:01:38,563 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-09-19 20:01:38,563 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-09-19 20:01:38,564 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-19 20:01:38,564 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-19 20:01:38,565 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 20:01:38,565 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 20:01:38,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 20:01:38,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 20:01:38,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 20:01:38,565 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:38,565 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 20:01:38,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 20:01:38,566 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 20:01:38,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 20:01:38,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-19 20:01:38,566 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:38,566 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:38,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-19 20:01:38,566 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-19 20:01:38,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-19 20:01:38,566 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:38,567 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-19 20:01:38,566 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-19 20:01:38,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-19 20:01:38,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-19 20:01:38,567 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-19 20:01:38,567 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-19 20:01:38,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-19 20:01:38,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-19 20:01:38,567 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-19 20:01:38,567 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-19 20:01:38,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-19 20:01:38,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-19 20:01:38,567 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-19 20:01:38,567 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-19 20:01:38,567 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-19 20:01:38,568 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 20:01:38,567 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-19 20:01:38,567 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 20:01:38,569 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-19 20:01:38,570 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-19 20:01:38,570 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-19 20:01:38,571 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-19 20:01:38,570 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-19 20:01:38,570 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45123,1695153672695' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-19 20:01:38,571 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-19 20:01:38,571 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 20:01:38,571 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40839,1695153672784' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-19 20:01:38,572 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-19 20:01:38,572 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-19 20:01:38,572 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40397,1695153672742' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-19 20:01:38,574 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-19 20:01:38,574 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:38,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:38,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 20:01:38,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 20:01:38,575 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-19 20:01:38,575 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-19 20:01:38,575 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-19 20:01:38,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 20:01:38,576 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-19 20:01:38,576 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 20:01:38,575 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:38,576 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-19 20:01:38,576 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 20:01:38,575 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 20:01:38,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 20:01:38,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-19 20:01:38,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:38,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:38,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:38,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 20:01:38,578 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45123,1695153672695' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-09-19 20:01:38,578 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@512d8181[Count = 1] remaining members to acquire global barrier 2023-09-19 20:01:38,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:38,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 20:01:38,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 20:01:38,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 20:01:38,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 20:01:38,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-19 20:01:38,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:38,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:38,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:38,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 20:01:38,580 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40397,1695153672742' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-09-19 20:01:38,580 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@512d8181[Count = 0] remaining members to acquire global barrier 2023-09-19 20:01:38,580 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-09-19 20:01:38,580 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-19 20:01:38,583 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-19 20:01:38,583 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-19 20:01:38,583 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-19 20:01:38,583 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-19 20:01:38,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-19 20:01:38,583 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:38,583 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-19 20:01:38,583 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-19 20:01:38,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-19 20:01:38,583 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-19 20:01:38,583 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-19 20:01:38,583 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-19 20:01:38,583 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-19 20:01:38,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-19 20:01:38,583 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-19 20:01:38,583 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-19 20:01:38,583 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-19 20:01:38,583 DEBUG [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1695153697194.bd6db4e2e4e461b731249d855cd45af2. 2023-09-19 20:01:38,583 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:38,584 DEBUG [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1695153697194.bd6db4e2e4e461b731249d855cd45af2. started... 2023-09-19 20:01:38,584 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-19 20:01:38,583 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40839,1695153672784' in zk 2023-09-19 20:01:38,583 DEBUG [rs(jenkins-hbase4.apache.org,45123,1695153672695)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1695153697194.87a6398e108aad5b1b4af23cabfb21bb. 2023-09-19 20:01:38,584 INFO [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] regionserver.HRegion(2745): Flushing bd6db4e2e4e461b731249d855cd45af2 1/1 column families, dataSize=266 B heapSize=832 B 2023-09-19 20:01:38,584 DEBUG [rs(jenkins-hbase4.apache.org,45123,1695153672695)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1695153697194.87a6398e108aad5b1b4af23cabfb21bb. started... 2023-09-19 20:01:38,583 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-19 20:01:38,584 INFO [rs(jenkins-hbase4.apache.org,45123,1695153672695)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 87a6398e108aad5b1b4af23cabfb21bb 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-09-19 20:01:38,585 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-19 20:01:38,585 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 20:01:38,585 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-19 20:01:38,643 DEBUG [Listener at jenkins-hbase4.apache.org/45213] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-19 20:01:38,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-19 20:01:38,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-19 20:01:38,645 DEBUG [Listener at jenkins-hbase4.apache.org/45213] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-19 20:01:38,654 INFO [rs(jenkins-hbase4.apache.org,45123,1695153672695)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023091932993d6554c84607a7f83aa0d119c77a to hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023091932993d6554c84607a7f83aa0d119c77a 2023-09-19 20:01:38,655 INFO [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230919ccc1028986a04bd49b3f3f78a53a4051 to hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230919ccc1028986a04bd49b3f3f78a53a4051 2023-09-19 20:01:38,672 INFO [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemState/bd6db4e2e4e461b731249d855cd45af2/.tmp/cf/cb89e84165d64171be91a6f9a78efe4a 2023-09-19 20:01:38,681 DEBUG [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemState/bd6db4e2e4e461b731249d855cd45af2/.tmp/cf/cb89e84165d64171be91a6f9a78efe4a as hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemState/bd6db4e2e4e461b731249d855cd45af2/cf/cb89e84165d64171be91a6f9a78efe4a 2023-09-19 20:01:38,681 INFO [rs(jenkins-hbase4.apache.org,45123,1695153672695)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemState/87a6398e108aad5b1b4af23cabfb21bb/.tmp/cf/d8f13c1519084115a5fda6328fab6ebe 2023-09-19 20:01:38,688 INFO [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemState/bd6db4e2e4e461b731249d855cd45af2/cf/cb89e84165d64171be91a6f9a78efe4a, entries=4, sequenceid=6, filesize=5.6 K 2023-09-19 20:01:38,689 DEBUG [rs(jenkins-hbase4.apache.org,45123,1695153672695)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemState/87a6398e108aad5b1b4af23cabfb21bb/.tmp/cf/d8f13c1519084115a5fda6328fab6ebe as hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemState/87a6398e108aad5b1b4af23cabfb21bb/cf/d8f13c1519084115a5fda6328fab6ebe 2023-09-19 20:01:38,689 INFO [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for bd6db4e2e4e461b731249d855cd45af2 in 105ms, sequenceid=6, compaction requested=false 2023-09-19 20:01:38,691 DEBUG [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for bd6db4e2e4e461b731249d855cd45af2: 2023-09-19 20:01:38,691 DEBUG [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1695153697194.bd6db4e2e4e461b731249d855cd45af2.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-19 20:01:38,691 DEBUG [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-19 20:01:38,691 DEBUG [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemState/bd6db4e2e4e461b731249d855cd45af2/cf/cb89e84165d64171be91a6f9a78efe4a] hfiles 2023-09-19 20:01:38,692 DEBUG [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemState/bd6db4e2e4e461b731249d855cd45af2/cf/cb89e84165d64171be91a6f9a78efe4a for snapshot=snaptb0-testExportFileSystemState 2023-09-19 20:01:38,698 INFO [rs(jenkins-hbase4.apache.org,45123,1695153672695)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemState/87a6398e108aad5b1b4af23cabfb21bb/cf/d8f13c1519084115a5fda6328fab6ebe, entries=46, sequenceid=6, filesize=12.7 K 2023-09-19 20:01:38,699 INFO [rs(jenkins-hbase4.apache.org,45123,1695153672695)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 87a6398e108aad5b1b4af23cabfb21bb in 115ms, sequenceid=6, compaction requested=false 2023-09-19 20:01:38,699 DEBUG [rs(jenkins-hbase4.apache.org,45123,1695153672695)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 87a6398e108aad5b1b4af23cabfb21bb: 2023-09-19 20:01:38,699 DEBUG [rs(jenkins-hbase4.apache.org,45123,1695153672695)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1695153697194.87a6398e108aad5b1b4af23cabfb21bb.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-19 20:01:38,699 DEBUG [rs(jenkins-hbase4.apache.org,45123,1695153672695)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-19 20:01:38,700 DEBUG [rs(jenkins-hbase4.apache.org,45123,1695153672695)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemState/87a6398e108aad5b1b4af23cabfb21bb/cf/d8f13c1519084115a5fda6328fab6ebe] hfiles 2023-09-19 20:01:38,700 DEBUG [rs(jenkins-hbase4.apache.org,45123,1695153672695)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemState/87a6398e108aad5b1b4af23cabfb21bb/cf/d8f13c1519084115a5fda6328fab6ebe for snapshot=snaptb0-testExportFileSystemState 2023-09-19 20:01:38,707 DEBUG [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1695153697194.bd6db4e2e4e461b731249d855cd45af2. completed. 2023-09-19 20:01:38,707 DEBUG [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1695153697194.bd6db4e2e4e461b731249d855cd45af2. 2023-09-19 20:01:38,707 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-19 20:01:38,707 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-19 20:01:38,707 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:38,707 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-19 20:01:38,707 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40397,1695153672742' in zk 2023-09-19 20:01:38,712 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-19 20:01:38,712 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:38,712 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 20:01:38,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:38,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 20:01:38,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 20:01:38,712 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-19 20:01:38,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 20:01:38,715 DEBUG [rs(jenkins-hbase4.apache.org,45123,1695153672695)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1695153697194.87a6398e108aad5b1b4af23cabfb21bb. completed. 2023-09-19 20:01:38,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 20:01:38,715 DEBUG [rs(jenkins-hbase4.apache.org,45123,1695153672695)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1695153697194.87a6398e108aad5b1b4af23cabfb21bb. 2023-09-19 20:01:38,715 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-19 20:01:38,715 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-19 20:01:38,715 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:38,715 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-19 20:01:38,715 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45123,1695153672695' in zk 2023-09-19 20:01:38,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-19 20:01:38,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:38,717 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:38,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:38,717 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-19 20:01:38,717 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 20:01:38,717 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-19 20:01:38,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:38,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 20:01:38,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-19 20:01:38,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:38,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:38,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:38,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,40397,1695153672742': 2023-09-19 20:01:38,721 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40397,1695153672742' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-19 20:01:38,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:38,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 20:01:38,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 20:01:38,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 20:01:38,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 20:01:38,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-19 20:01:38,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:38,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:38,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:38,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 20:01:38,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-19 20:01:38,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:38,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:38,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:38,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,45123,1695153672695': 2023-09-19 20:01:38,724 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45123,1695153672695' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-19 20:01:38,724 INFO [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-09-19 20:01:38,724 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-19 20:01:38,724 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-19 20:01:38,724 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-09-19 20:01:38,724 INFO [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-19 20:01:38,726 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-19 20:01:38,726 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-19 20:01:38,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-19 20:01:38,726 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-19 20:01:38,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 20:01:38,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-19 20:01:38,726 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 20:01:38,726 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-19 20:01:38,726 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-19 20:01:38,726 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 20:01:38,726 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-19 20:01:38,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-19 20:01:38,726 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 20:01:38,727 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 20:01:38,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 20:01:38,726 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-19 20:01:38,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 20:01:38,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-19 20:01:38,727 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 20:01:38,727 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:38,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 20:01:38,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-19 20:01:38,727 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 20:01:38,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 20:01:38,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 20:01:38,727 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:38,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-19 20:01:38,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-19 20:01:38,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-19 20:01:38,728 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:38,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 20:01:38,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-19 20:01:38,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:38,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:38,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:38,732 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:38,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 20:01:38,732 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:38,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-19 20:01:38,732 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:38,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:38,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:38,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:38,736 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 20:01:38,736 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:38,736 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 20:01:38,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 20:01:38,737 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 20:01:38,737 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 20:01:38,737 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 20:01:38,737 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 20:01:38,737 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 20:01:38,737 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-09-19 20:01:38,737 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-19 20:01:38,737 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 20:01:38,737 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-09-19 20:01:38,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 20:01:38,739 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-19 20:01:38,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 20:01:38,739 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-19 20:01:38,739 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 20:01:38,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 20:01:38,739 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 20:01:38,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 20:01:38,739 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:38,739 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:38,739 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-19 20:01:38,739 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:38,739 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-19 20:01:38,739 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:38,739 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:38,739 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-19 20:01:38,740 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-19 20:01:38,740 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 20:01:38,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 20:01:38,740 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 20:01:38,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 20:01:38,740 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023091932993d6554c84607a7f83aa0d119c77a, hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230919ccc1028986a04bd49b3f3f78a53a4051] mob files 2023-09-19 20:01:38,740 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023091932993d6554c84607a7f83aa0d119c77a 2023-09-19 20:01:38,740 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230919ccc1028986a04bd49b3f3f78a53a4051 2023-09-19 20:01:38,749 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-09-19 20:01:38,750 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-19 20:01:38,778 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-19 20:01:38,779 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-09-19 20:01:38,779 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-19 20:01:38,779 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-19 20:01:38,779 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1695153698541Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1695153698749 (+208 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1695153698749Loading Region manifests for snaptb0-testExportFileSystemState at 1695153698749Writing data manifest for snaptb0-testExportFileSystemState at 1695153698754 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1695153698764 (+10 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1695153698779 (+15 ms) 2023-09-19 20:01:38,783 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-19 20:01:38,785 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 241 msec 2023-09-19 20:01:38,845 DEBUG [Listener at jenkins-hbase4.apache.org/45213] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-19 20:01:38,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-19 20:01:38,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-19 20:01:38,847 INFO [Listener at jenkins-hbase4.apache.org/45213] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/export-test/export-1695153698847 2023-09-19 20:01:38,847 INFO [Listener at jenkins-hbase4.apache.org/45213] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:38739, tgtDir=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/export-test/export-1695153698847, rawTgtDir=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/export-test/export-1695153698847, srcFsUri=hdfs://localhost:38739, srcDir=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf 2023-09-19 20:01:38,871 DEBUG [Listener at jenkins-hbase4.apache.org/45213] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:38739, inputRoot=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf 2023-09-19 20:01:38,871 DEBUG [Listener at jenkins-hbase4.apache.org/45213] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1047374436_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/export-test/export-1695153698847, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/export-test/export-1695153698847/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-19 20:01:38,871 INFO [Listener at jenkins-hbase4.apache.org/45213] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:38739, inputRoot=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf, snapshotDir=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-09-19 20:01:38,889 INFO [Listener at jenkins-hbase4.apache.org/45213] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/export-test/export-1695153698847/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-19 20:01:38,930 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-19 20:01:38,931 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-19 20:01:38,931 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-19 20:01:38,932 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-19 20:01:39,842 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59/hadoop-1703654874491693890.jar 2023-09-19 20:01:39,842 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-19 20:01:39,843 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-19 20:01:39,916 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59/hadoop-3468460304857613055.jar 2023-09-19 20:01:39,917 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-19 20:01:39,917 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-19 20:01:39,918 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-19 20:01:39,918 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-19 20:01:39,918 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-19 20:01:39,919 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-19 20:01:39,919 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-19 20:01:39,919 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-19 20:01:39,920 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-19 20:01:39,920 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-19 20:01:39,920 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-19 20:01:39,921 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-19 20:01:39,921 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-19 20:01:39,922 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-19 20:01:39,922 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-19 20:01:39,922 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-19 20:01:39,923 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-19 20:01:39,923 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-19 20:01:39,924 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-19 20:01:39,924 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-19 20:01:39,924 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-19 20:01:39,925 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-19 20:01:39,926 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-19 20:01:40,405 WARN [Listener at jenkins-hbase4.apache.org/45213] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-19 20:01:40,408 INFO [Listener at jenkins-hbase4.apache.org/45213] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-09-19 20:01:40,411 DEBUG [Listener at jenkins-hbase4.apache.org/45213] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-09-19 20:01:41,648 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-19 20:01:41,648 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-19 20:01:41,655 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695153679175_0001_000001 (auth:SIMPLE) 2023-09-19 20:01:42,407 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695153679175_0002_000001 (auth:SIMPLE) 2023-09-19 20:01:42,442 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-19 20:01:46,561 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695153679175_0002_000001 (auth:SIMPLE) 2023-09-19 20:01:48,789 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695153679175_0002_000001 (auth:SIMPLE) 2023-09-19 20:01:52,018 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695153679175_0002_000001 (auth:SIMPLE) 2023-09-19 20:01:53,610 INFO [Listener at jenkins-hbase4.apache.org/45213] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-19 20:01:53,611 INFO [Listener at jenkins-hbase4.apache.org/45213] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-19 20:01:53,619 INFO [Listener at jenkins-hbase4.apache.org/45213] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-09-19 20:01:53,619 INFO [Listener at jenkins-hbase4.apache.org/45213] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-19 20:01:53,620 INFO [Listener at jenkins-hbase4.apache.org/45213] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-19 20:01:53,620 DEBUG [Listener at jenkins-hbase4.apache.org/45213] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1909323301_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-19 20:01:53,620 DEBUG [Listener at jenkins-hbase4.apache.org/45213] snapshot.TestExportSnapshot(367): hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-09-19 20:01:53,621 DEBUG [Listener at jenkins-hbase4.apache.org/45213] snapshot.TestExportSnapshot(367): hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-09-19 20:01:53,621 DEBUG [Listener at jenkins-hbase4.apache.org/45213] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1909323301_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/export-test/export-1695153698847/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/export-test/export-1695153698847/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-19 20:01:53,621 DEBUG [Listener at jenkins-hbase4.apache.org/45213] snapshot.TestExportSnapshot(367): hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/export-test/export-1695153698847/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-09-19 20:01:53,621 DEBUG [Listener at jenkins-hbase4.apache.org/45213] snapshot.TestExportSnapshot(367): hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/export-test/export-1695153698847/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-09-19 20:01:53,628 INFO [Listener at jenkins-hbase4.apache.org/45213] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-09-19 20:01:53,629 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-09-19 20:01:53,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] procedure2.ProcedureExecutor(1028): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-09-19 20:01:53,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-19 20:01:53,635 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695153713635"}]},"ts":"1695153713635"} 2023-09-19 20:01:53,638 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-09-19 20:01:53,639 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-09-19 20:01:53,641 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=bd6db4e2e4e461b731249d855cd45af2, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=87a6398e108aad5b1b4af23cabfb21bb, UNASSIGN}] 2023-09-19 20:01:53,644 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=bd6db4e2e4e461b731249d855cd45af2, UNASSIGN 2023-09-19 20:01:53,644 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=87a6398e108aad5b1b4af23cabfb21bb, UNASSIGN 2023-09-19 20:01:53,645 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=bd6db4e2e4e461b731249d855cd45af2, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:53,645 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1695153697194.bd6db4e2e4e461b731249d855cd45af2.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695153713645"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695153713645"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695153713645"}]},"ts":"1695153713645"} 2023-09-19 20:01:53,645 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=87a6398e108aad5b1b4af23cabfb21bb, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:53,645 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1695153697194.87a6398e108aad5b1b4af23cabfb21bb.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695153713645"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695153713645"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695153713645"}]},"ts":"1695153713645"} 2023-09-19 20:01:53,647 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure bd6db4e2e4e461b731249d855cd45af2, server=jenkins-hbase4.apache.org,40397,1695153672742}] 2023-09-19 20:01:53,648 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure 87a6398e108aad5b1b4af23cabfb21bb, server=jenkins-hbase4.apache.org,45123,1695153672695}] 2023-09-19 20:01:53,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-19 20:01:53,800 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close bd6db4e2e4e461b731249d855cd45af2 2023-09-19 20:01:53,800 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing bd6db4e2e4e461b731249d855cd45af2, disabling compactions & flushes 2023-09-19 20:01:53,800 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1695153697194.bd6db4e2e4e461b731249d855cd45af2. 2023-09-19 20:01:53,800 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1695153697194.bd6db4e2e4e461b731249d855cd45af2. 2023-09-19 20:01:53,800 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1695153697194.bd6db4e2e4e461b731249d855cd45af2. after waiting 0 ms 2023-09-19 20:01:53,800 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1695153697194.bd6db4e2e4e461b731249d855cd45af2. 2023-09-19 20:01:53,800 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 87a6398e108aad5b1b4af23cabfb21bb 2023-09-19 20:01:53,801 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 87a6398e108aad5b1b4af23cabfb21bb, disabling compactions & flushes 2023-09-19 20:01:53,801 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1695153697194.87a6398e108aad5b1b4af23cabfb21bb. 2023-09-19 20:01:53,801 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1695153697194.87a6398e108aad5b1b4af23cabfb21bb. 2023-09-19 20:01:53,804 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1695153697194.87a6398e108aad5b1b4af23cabfb21bb. after waiting 0 ms 2023-09-19 20:01:53,804 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1695153697194.87a6398e108aad5b1b4af23cabfb21bb. 2023-09-19 20:01:53,810 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemState/bd6db4e2e4e461b731249d855cd45af2/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-19 20:01:53,810 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemState/87a6398e108aad5b1b4af23cabfb21bb/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-19 20:01:53,811 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-19 20:01:53,811 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-19 20:01:53,812 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1695153697194.bd6db4e2e4e461b731249d855cd45af2. 2023-09-19 20:01:53,813 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for bd6db4e2e4e461b731249d855cd45af2: 2023-09-19 20:01:53,813 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1695153697194.87a6398e108aad5b1b4af23cabfb21bb. 2023-09-19 20:01:53,813 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 87a6398e108aad5b1b4af23cabfb21bb: 2023-09-19 20:01:53,814 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed bd6db4e2e4e461b731249d855cd45af2 2023-09-19 20:01:53,815 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=bd6db4e2e4e461b731249d855cd45af2, regionState=CLOSED 2023-09-19 20:01:53,815 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1695153697194.bd6db4e2e4e461b731249d855cd45af2.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695153713815"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695153713815"}]},"ts":"1695153713815"} 2023-09-19 20:01:53,815 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 87a6398e108aad5b1b4af23cabfb21bb 2023-09-19 20:01:53,816 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=87a6398e108aad5b1b4af23cabfb21bb, regionState=CLOSED 2023-09-19 20:01:53,816 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1695153697194.87a6398e108aad5b1b4af23cabfb21bb.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695153713816"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695153713816"}]},"ts":"1695153713816"} 2023-09-19 20:01:53,819 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=39, resume processing ppid=37 2023-09-19 20:01:53,819 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure bd6db4e2e4e461b731249d855cd45af2, server=jenkins-hbase4.apache.org,40397,1695153672742 in 170 msec 2023-09-19 20:01:53,820 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=40, resume processing ppid=38 2023-09-19 20:01:53,820 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure 87a6398e108aad5b1b4af23cabfb21bb, server=jenkins-hbase4.apache.org,45123,1695153672695 in 170 msec 2023-09-19 20:01:53,820 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=bd6db4e2e4e461b731249d855cd45af2, UNASSIGN in 178 msec 2023-09-19 20:01:53,822 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=38, resume processing ppid=36 2023-09-19 20:01:53,822 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=87a6398e108aad5b1b4af23cabfb21bb, UNASSIGN in 179 msec 2023-09-19 20:01:53,822 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695153713822"}]},"ts":"1695153713822"} 2023-09-19 20:01:53,824 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-09-19 20:01:53,826 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-09-19 20:01:53,828 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 198 msec 2023-09-19 20:01:53,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-19 20:01:53,937 INFO [Listener at jenkins-hbase4.apache.org/45213] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-09-19 20:01:53,938 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-09-19 20:01:53,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] procedure2.ProcedureExecutor(1028): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-19 20:01:53,942 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-19 20:01:53,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-09-19 20:01:53,943 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-19 20:01:53,945 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40839] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-09-19 20:01:53,949 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportFileSystemState/bd6db4e2e4e461b731249d855cd45af2 2023-09-19 20:01:53,949 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-19 20:01:53,949 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-19 20:01:53,949 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-19 20:01:53,949 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportFileSystemState/87a6398e108aad5b1b4af23cabfb21bb 2023-09-19 20:01:53,949 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-19 20:01:53,950 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-19 20:01:53,950 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-19 20:01:53,950 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-19 20:01:53,950 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-19 20:01:53,951 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-19 20:01:53,951 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 20:01:53,952 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportFileSystemState/bd6db4e2e4e461b731249d855cd45af2/cf, FileablePath, hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportFileSystemState/bd6db4e2e4e461b731249d855cd45af2/recovered.edits] 2023-09-19 20:01:53,951 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-19 20:01:53,951 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-19 20:01:53,952 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 20:01:53,952 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 20:01:53,952 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportFileSystemState/87a6398e108aad5b1b4af23cabfb21bb/cf, FileablePath, hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportFileSystemState/87a6398e108aad5b1b4af23cabfb21bb/recovered.edits] 2023-09-19 20:01:53,952 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-19 20:01:53,953 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 20:01:53,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-09-19 20:01:53,957 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportFileSystemState/bd6db4e2e4e461b731249d855cd45af2/cf/cb89e84165d64171be91a6f9a78efe4a to hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/archive/data/default/testtb-testExportFileSystemState/bd6db4e2e4e461b731249d855cd45af2/cf/cb89e84165d64171be91a6f9a78efe4a 2023-09-19 20:01:53,957 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportFileSystemState/87a6398e108aad5b1b4af23cabfb21bb/cf/d8f13c1519084115a5fda6328fab6ebe to hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/archive/data/default/testtb-testExportFileSystemState/87a6398e108aad5b1b4af23cabfb21bb/cf/d8f13c1519084115a5fda6328fab6ebe 2023-09-19 20:01:53,961 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportFileSystemState/bd6db4e2e4e461b731249d855cd45af2/recovered.edits/9.seqid to hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/archive/data/default/testtb-testExportFileSystemState/bd6db4e2e4e461b731249d855cd45af2/recovered.edits/9.seqid 2023-09-19 20:01:53,961 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportFileSystemState/87a6398e108aad5b1b4af23cabfb21bb/recovered.edits/9.seqid to hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/archive/data/default/testtb-testExportFileSystemState/87a6398e108aad5b1b4af23cabfb21bb/recovered.edits/9.seqid 2023-09-19 20:01:53,962 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportFileSystemState/bd6db4e2e4e461b731249d855cd45af2 2023-09-19 20:01:53,962 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportFileSystemState/87a6398e108aad5b1b4af23cabfb21bb 2023-09-19 20:01:53,962 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-09-19 20:01:53,962 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-09-19 20:01:53,963 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-09-19 20:01:53,967 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023091932993d6554c84607a7f83aa0d119c77a to hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023091932993d6554c84607a7f83aa0d119c77a 2023-09-19 20:01:53,969 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230919ccc1028986a04bd49b3f3f78a53a4051 to hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230919ccc1028986a04bd49b3f3f78a53a4051 2023-09-19 20:01:53,969 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-09-19 20:01:53,972 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-19 20:01:53,974 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-09-19 20:01:53,977 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-09-19 20:01:53,978 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-19 20:01:53,978 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-09-19 20:01:53,978 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1695153697194.bd6db4e2e4e461b731249d855cd45af2.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695153713978"}]},"ts":"9223372036854775807"} 2023-09-19 20:01:53,978 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1695153697194.87a6398e108aad5b1b4af23cabfb21bb.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695153713978"}]},"ts":"9223372036854775807"} 2023-09-19 20:01:53,980 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-19 20:01:53,981 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => bd6db4e2e4e461b731249d855cd45af2, NAME => 'testtb-testExportFileSystemState,,1695153697194.bd6db4e2e4e461b731249d855cd45af2.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 87a6398e108aad5b1b4af23cabfb21bb, NAME => 'testtb-testExportFileSystemState,1,1695153697194.87a6398e108aad5b1b4af23cabfb21bb.', STARTKEY => '1', ENDKEY => ''}] 2023-09-19 20:01:53,981 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-09-19 20:01:53,981 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695153713981"}]},"ts":"9223372036854775807"} 2023-09-19 20:01:53,982 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-09-19 20:01:53,984 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-19 20:01:53,986 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 46 msec 2023-09-19 20:01:54,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-09-19 20:01:54,055 INFO [Listener at jenkins-hbase4.apache.org/45213] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-09-19 20:01:54,063 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-09-19 20:01:54,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-09-19 20:01:54,067 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-09-19 20:01:54,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-09-19 20:01:54,093 INFO [Listener at jenkins-hbase4.apache.org/45213] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=768 (was 755) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1909323301_17 at /127.0.0.1:54750 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x51b5961f-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x51b5961f-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1781244183) connection to jenkins-hbase4.apache.org/172.31.14.131:42301 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1909323301_17 at /127.0.0.1:42310 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x51b5961f-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-2079 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1909323301_17 at /127.0.0.1:39884 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_789459595_1 at /127.0.0.1:54722 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x51b5961f-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_789459595_1 at /127.0.0.1:39864 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=937 (was 935) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=223 (was 195) - SystemLoadAverage LEAK? -, ProcessCount=169 (was 169), AvailableMemoryMB=7775 (was 7954) 2023-09-19 20:01:54,094 WARN [Listener at jenkins-hbase4.apache.org/45213] hbase.ResourceChecker(130): Thread=768 is superior to 500 2023-09-19 20:01:54,113 INFO [Listener at jenkins-hbase4.apache.org/45213] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=768, OpenFileDescriptor=935, MaxFileDescriptor=60000, SystemLoadAverage=223, ProcessCount=169, AvailableMemoryMB=7775 2023-09-19 20:01:54,113 WARN [Listener at jenkins-hbase4.apache.org/45213] hbase.ResourceChecker(130): Thread=768 is superior to 500 2023-09-19 20:01:54,115 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-19 20:01:54,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] procedure2.ProcedureExecutor(1028): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-09-19 20:01:54,119 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-09-19 20:01:54,119 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-09-19 20:01:54,120 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-19 20:01:54,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-19 20:01:54,122 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testConsecutiveExports/3a01b44606d97cb3abc29dca8b01ea0d 2023-09-19 20:01:54,122 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testConsecutiveExports/3a90d9960d6a8e7778815674df3f5bd2 2023-09-19 20:01:54,123 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testConsecutiveExports/3a01b44606d97cb3abc29dca8b01ea0d empty. 2023-09-19 20:01:54,123 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testConsecutiveExports/3a90d9960d6a8e7778815674df3f5bd2 empty. 2023-09-19 20:01:54,123 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testConsecutiveExports/3a01b44606d97cb3abc29dca8b01ea0d 2023-09-19 20:01:54,124 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testConsecutiveExports/3a90d9960d6a8e7778815674df3f5bd2 2023-09-19 20:01:54,124 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-09-19 20:01:54,136 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-09-19 20:01:54,137 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 3a01b44606d97cb3abc29dca8b01ea0d, NAME => 'testtb-testConsecutiveExports,,1695153714114.3a01b44606d97cb3abc29dca8b01ea0d.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp 2023-09-19 20:01:54,138 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 3a90d9960d6a8e7778815674df3f5bd2, NAME => 'testtb-testConsecutiveExports,1,1695153714114.3a90d9960d6a8e7778815674df3f5bd2.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp 2023-09-19 20:01:54,150 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1695153714114.3a90d9960d6a8e7778815674df3f5bd2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 20:01:54,150 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 3a90d9960d6a8e7778815674df3f5bd2, disabling compactions & flushes 2023-09-19 20:01:54,150 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1695153714114.3a90d9960d6a8e7778815674df3f5bd2. 2023-09-19 20:01:54,150 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1695153714114.3a90d9960d6a8e7778815674df3f5bd2. 2023-09-19 20:01:54,150 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1695153714114.3a90d9960d6a8e7778815674df3f5bd2. after waiting 0 ms 2023-09-19 20:01:54,150 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1695153714114.3a90d9960d6a8e7778815674df3f5bd2. 2023-09-19 20:01:54,151 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1695153714114.3a90d9960d6a8e7778815674df3f5bd2. 2023-09-19 20:01:54,151 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 3a90d9960d6a8e7778815674df3f5bd2: 2023-09-19 20:01:54,154 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1695153714114.3a01b44606d97cb3abc29dca8b01ea0d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 20:01:54,154 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 3a01b44606d97cb3abc29dca8b01ea0d, disabling compactions & flushes 2023-09-19 20:01:54,154 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1695153714114.3a01b44606d97cb3abc29dca8b01ea0d. 2023-09-19 20:01:54,154 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1695153714114.3a01b44606d97cb3abc29dca8b01ea0d. 2023-09-19 20:01:54,154 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1695153714114.3a01b44606d97cb3abc29dca8b01ea0d. after waiting 0 ms 2023-09-19 20:01:54,154 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1695153714114.3a01b44606d97cb3abc29dca8b01ea0d. 2023-09-19 20:01:54,154 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1695153714114.3a01b44606d97cb3abc29dca8b01ea0d. 2023-09-19 20:01:54,154 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 3a01b44606d97cb3abc29dca8b01ea0d: 2023-09-19 20:01:54,157 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-09-19 20:01:54,158 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1695153714114.3a90d9960d6a8e7778815674df3f5bd2.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695153714157"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695153714157"}]},"ts":"1695153714157"} 2023-09-19 20:01:54,158 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1695153714114.3a01b44606d97cb3abc29dca8b01ea0d.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695153714157"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695153714157"}]},"ts":"1695153714157"} 2023-09-19 20:01:54,160 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-19 20:01:54,161 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-19 20:01:54,161 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695153714161"}]},"ts":"1695153714161"} 2023-09-19 20:01:54,163 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-09-19 20:01:54,167 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-19 20:01:54,169 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-19 20:01:54,169 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-19 20:01:54,169 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-19 20:01:54,169 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-19 20:01:54,169 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=3a01b44606d97cb3abc29dca8b01ea0d, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=3a90d9960d6a8e7778815674df3f5bd2, ASSIGN}] 2023-09-19 20:01:54,172 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=3a90d9960d6a8e7778815674df3f5bd2, ASSIGN 2023-09-19 20:01:54,172 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=3a01b44606d97cb3abc29dca8b01ea0d, ASSIGN 2023-09-19 20:01:54,173 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=3a90d9960d6a8e7778815674df3f5bd2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40397,1695153672742; forceNewPlan=false, retain=false 2023-09-19 20:01:54,173 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=3a01b44606d97cb3abc29dca8b01ea0d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40839,1695153672784; forceNewPlan=false, retain=false 2023-09-19 20:01:54,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-19 20:01:54,323 INFO [jenkins-hbase4:37929] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-19 20:01:54,326 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=3a90d9960d6a8e7778815674df3f5bd2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:54,326 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=3a01b44606d97cb3abc29dca8b01ea0d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:54,326 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1695153714114.3a90d9960d6a8e7778815674df3f5bd2.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695153714326"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695153714326"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695153714326"}]},"ts":"1695153714326"} 2023-09-19 20:01:54,326 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1695153714114.3a01b44606d97cb3abc29dca8b01ea0d.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695153714326"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695153714326"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695153714326"}]},"ts":"1695153714326"} 2023-09-19 20:01:54,328 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE; OpenRegionProcedure 3a90d9960d6a8e7778815674df3f5bd2, server=jenkins-hbase4.apache.org,40397,1695153672742}] 2023-09-19 20:01:54,329 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; OpenRegionProcedure 3a01b44606d97cb3abc29dca8b01ea0d, server=jenkins-hbase4.apache.org,40839,1695153672784}] 2023-09-19 20:01:54,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-19 20:01:54,484 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1695153714114.3a90d9960d6a8e7778815674df3f5bd2. 2023-09-19 20:01:54,484 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3a90d9960d6a8e7778815674df3f5bd2, NAME => 'testtb-testConsecutiveExports,1,1695153714114.3a90d9960d6a8e7778815674df3f5bd2.', STARTKEY => '1', ENDKEY => ''} 2023-09-19 20:01:54,484 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1695153714114.3a01b44606d97cb3abc29dca8b01ea0d. 2023-09-19 20:01:54,484 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3a01b44606d97cb3abc29dca8b01ea0d, NAME => 'testtb-testConsecutiveExports,,1695153714114.3a01b44606d97cb3abc29dca8b01ea0d.', STARTKEY => '', ENDKEY => '1'} 2023-09-19 20:01:54,484 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1695153714114.3a90d9960d6a8e7778815674df3f5bd2. service=AccessControlService 2023-09-19 20:01:54,484 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1695153714114.3a01b44606d97cb3abc29dca8b01ea0d. service=AccessControlService 2023-09-19 20:01:54,485 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-19 20:01:54,485 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-19 20:01:54,485 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 3a90d9960d6a8e7778815674df3f5bd2 2023-09-19 20:01:54,485 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 3a01b44606d97cb3abc29dca8b01ea0d 2023-09-19 20:01:54,485 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1695153714114.3a90d9960d6a8e7778815674df3f5bd2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 20:01:54,485 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1695153714114.3a01b44606d97cb3abc29dca8b01ea0d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 20:01:54,485 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 3a90d9960d6a8e7778815674df3f5bd2 2023-09-19 20:01:54,485 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 3a01b44606d97cb3abc29dca8b01ea0d 2023-09-19 20:01:54,485 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 3a90d9960d6a8e7778815674df3f5bd2 2023-09-19 20:01:54,485 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 3a01b44606d97cb3abc29dca8b01ea0d 2023-09-19 20:01:54,486 INFO [StoreOpener-3a01b44606d97cb3abc29dca8b01ea0d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 3a01b44606d97cb3abc29dca8b01ea0d 2023-09-19 20:01:54,486 INFO [StoreOpener-3a90d9960d6a8e7778815674df3f5bd2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 3a90d9960d6a8e7778815674df3f5bd2 2023-09-19 20:01:54,488 DEBUG [StoreOpener-3a90d9960d6a8e7778815674df3f5bd2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testConsecutiveExports/3a90d9960d6a8e7778815674df3f5bd2/cf 2023-09-19 20:01:54,488 DEBUG [StoreOpener-3a90d9960d6a8e7778815674df3f5bd2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testConsecutiveExports/3a90d9960d6a8e7778815674df3f5bd2/cf 2023-09-19 20:01:54,488 DEBUG [StoreOpener-3a01b44606d97cb3abc29dca8b01ea0d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testConsecutiveExports/3a01b44606d97cb3abc29dca8b01ea0d/cf 2023-09-19 20:01:54,488 DEBUG [StoreOpener-3a01b44606d97cb3abc29dca8b01ea0d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testConsecutiveExports/3a01b44606d97cb3abc29dca8b01ea0d/cf 2023-09-19 20:01:54,488 INFO [StoreOpener-3a90d9960d6a8e7778815674df3f5bd2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3a90d9960d6a8e7778815674df3f5bd2 columnFamilyName cf 2023-09-19 20:01:54,488 INFO [StoreOpener-3a01b44606d97cb3abc29dca8b01ea0d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3a01b44606d97cb3abc29dca8b01ea0d columnFamilyName cf 2023-09-19 20:01:54,489 INFO [StoreOpener-3a90d9960d6a8e7778815674df3f5bd2-1] regionserver.HStore(310): Store=3a90d9960d6a8e7778815674df3f5bd2/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-19 20:01:54,489 INFO [StoreOpener-3a01b44606d97cb3abc29dca8b01ea0d-1] regionserver.HStore(310): Store=3a01b44606d97cb3abc29dca8b01ea0d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-19 20:01:54,491 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testConsecutiveExports/3a01b44606d97cb3abc29dca8b01ea0d 2023-09-19 20:01:54,491 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testConsecutiveExports/3a90d9960d6a8e7778815674df3f5bd2 2023-09-19 20:01:54,491 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testConsecutiveExports/3a01b44606d97cb3abc29dca8b01ea0d 2023-09-19 20:01:54,491 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testConsecutiveExports/3a90d9960d6a8e7778815674df3f5bd2 2023-09-19 20:01:54,494 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 3a01b44606d97cb3abc29dca8b01ea0d 2023-09-19 20:01:54,494 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 3a90d9960d6a8e7778815674df3f5bd2 2023-09-19 20:01:54,496 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testConsecutiveExports/3a90d9960d6a8e7778815674df3f5bd2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-19 20:01:54,496 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testConsecutiveExports/3a01b44606d97cb3abc29dca8b01ea0d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-19 20:01:54,496 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 3a90d9960d6a8e7778815674df3f5bd2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65387182, jitterRate=-0.02565506100654602}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-19 20:01:54,496 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 3a01b44606d97cb3abc29dca8b01ea0d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62574706, jitterRate=-0.0675642192363739}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-19 20:01:54,496 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 3a90d9960d6a8e7778815674df3f5bd2: 2023-09-19 20:01:54,496 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 3a01b44606d97cb3abc29dca8b01ea0d: 2023-09-19 20:01:54,497 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1695153714114.3a01b44606d97cb3abc29dca8b01ea0d., pid=46, masterSystemTime=1695153714481 2023-09-19 20:01:54,497 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1695153714114.3a90d9960d6a8e7778815674df3f5bd2., pid=45, masterSystemTime=1695153714480 2023-09-19 20:01:54,499 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1695153714114.3a01b44606d97cb3abc29dca8b01ea0d. 2023-09-19 20:01:54,499 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1695153714114.3a01b44606d97cb3abc29dca8b01ea0d. 2023-09-19 20:01:54,499 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=3a01b44606d97cb3abc29dca8b01ea0d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:54,500 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1695153714114.3a90d9960d6a8e7778815674df3f5bd2. 2023-09-19 20:01:54,500 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1695153714114.3a90d9960d6a8e7778815674df3f5bd2. 2023-09-19 20:01:54,500 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1695153714114.3a01b44606d97cb3abc29dca8b01ea0d.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695153714499"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695153714499"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695153714499"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695153714499"}]},"ts":"1695153714499"} 2023-09-19 20:01:54,500 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=3a90d9960d6a8e7778815674df3f5bd2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:54,500 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1695153714114.3a90d9960d6a8e7778815674df3f5bd2.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695153714500"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695153714500"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695153714500"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695153714500"}]},"ts":"1695153714500"} 2023-09-19 20:01:54,504 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=46, resume processing ppid=43 2023-09-19 20:01:54,504 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=46, ppid=43, state=SUCCESS; OpenRegionProcedure 3a01b44606d97cb3abc29dca8b01ea0d, server=jenkins-hbase4.apache.org,40839,1695153672784 in 173 msec 2023-09-19 20:01:54,505 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=45, resume processing ppid=44 2023-09-19 20:01:54,505 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=45, ppid=44, state=SUCCESS; OpenRegionProcedure 3a90d9960d6a8e7778815674df3f5bd2, server=jenkins-hbase4.apache.org,40397,1695153672742 in 175 msec 2023-09-19 20:01:54,506 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=3a01b44606d97cb3abc29dca8b01ea0d, ASSIGN in 335 msec 2023-09-19 20:01:54,507 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=44, resume processing ppid=42 2023-09-19 20:01:54,507 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=3a90d9960d6a8e7778815674df3f5bd2, ASSIGN in 336 msec 2023-09-19 20:01:54,508 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-19 20:01:54,509 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695153714508"}]},"ts":"1695153714508"} 2023-09-19 20:01:54,510 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-09-19 20:01:54,512 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-09-19 20:01:54,513 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-09-19 20:01:54,515 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40839] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-19 20:01:54,516 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 20:01:54,516 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 20:01:54,516 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 20:01:54,516 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 20:01:54,517 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-19 20:01:54,517 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-19 20:01:54,517 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-19 20:01:54,517 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-19 20:01:54,519 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 403 msec 2023-09-19 20:01:54,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-19 20:01:54,724 INFO [Listener at jenkins-hbase4.apache.org/45213] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-09-19 20:01:54,727 DEBUG [Listener at jenkins-hbase4.apache.org/45213] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-09-19 20:01:54,727 DEBUG [Listener at jenkins-hbase4.apache.org/45213] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1695153714114.3a01b44606d97cb3abc29dca8b01ea0d. 2023-09-19 20:01:54,729 INFO [Listener at jenkins-hbase4.apache.org/45213] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-19 20:01:54,741 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-19 20:01:54,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695153714741 (current time:1695153714741). 2023-09-19 20:01:54,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-19 20:01:54,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] zookeeper.ReadOnlyZKClient(139): Connect 0x21e66b95 to 127.0.0.1:60323 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-19 20:01:54,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@78ba064, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-19 20:01:54,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 20:01:54,757 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40106, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 20:01:54,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x21e66b95 to 127.0.0.1:60323 2023-09-19 20:01:54,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 20:01:54,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] zookeeper.ReadOnlyZKClient(139): Connect 0x281792e1 to 127.0.0.1:60323 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-19 20:01:54,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3abffeb5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-19 20:01:54,768 DEBUG [hconnection-0x60ede106-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 20:01:54,771 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40118, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 20:01:54,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 20:01:54,777 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52976, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 20:01:54,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x281792e1 to 127.0.0.1:60323 2023-09-19 20:01:54,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 20:01:54,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-19 20:01:54,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-19 20:01:54,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-19 20:01:54,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] procedure2.ProcedureExecutor(1028): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-19 20:01:54,783 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-19 20:01:54,784 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1695154314783 2023-09-19 20:01:54,784 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-09-19 20:01:54,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-19 20:01:54,785 DEBUG [Listener at jenkins-hbase4.apache.org/45213] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-19 20:01:54,785 DEBUG [Listener at jenkins-hbase4.apache.org/45213] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-19 20:01:54,786 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-19 20:01:54,786 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-19 20:01:54,787 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 6 msec 2023-09-19 20:01:54,788 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-19 20:01:54,789 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1695154314789 2023-09-19 20:01:54,802 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-09-19 20:01:54,802 INFO [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-09-19 20:01:54,802 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 20:01:54,803 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-09-19 20:01:54,804 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-09-19 20:01:54,804 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-19 20:01:54,804 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-19 20:01:54,807 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 20:01:54,807 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:54,807 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 20:01:54,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 20:01:54,807 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 20:01:54,807 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 20:01:54,808 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 20:01:54,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 20:01:54,808 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 20:01:54,808 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:54,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-19 20:01:54,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 20:01:54,808 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:54,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-19 20:01:54,808 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-19 20:01:54,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-19 20:01:54,808 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:54,808 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-19 20:01:54,808 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-19 20:01:54,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-19 20:01:54,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-19 20:01:54,809 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-19 20:01:54,809 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-19 20:01:54,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-19 20:01:54,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-19 20:01:54,809 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-19 20:01:54,809 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-19 20:01:54,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-19 20:01:54,809 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-19 20:01:54,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-19 20:01:54,809 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 20:01:54,809 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-19 20:01:54,811 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-19 20:01:54,811 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-19 20:01:54,811 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-19 20:01:54,811 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-19 20:01:54,811 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-19 20:01:54,811 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 20:01:54,811 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-19 20:01:54,812 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-19 20:01:54,812 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-19 20:01:54,812 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40839,1695153672784' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-19 20:01:54,811 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45123,1695153672695' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-19 20:01:54,812 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 20:01:54,816 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-19 20:01:54,816 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-19 20:01:54,816 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40397,1695153672742' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-19 20:01:54,817 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:54,817 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-19 20:01:54,817 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-19 20:01:54,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:54,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 20:01:54,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 20:01:54,818 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:54,818 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-19 20:01:54,818 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-19 20:01:54,818 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 20:01:54,818 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-19 20:01:54,818 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 20:01:54,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 20:01:54,818 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-19 20:01:54,818 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 20:01:54,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 20:01:54,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-19 20:01:54,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:54,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:54,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:54,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 20:01:54,820 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40839,1695153672784' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-09-19 20:01:54,821 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@8f62028[Count = 1] remaining members to acquire global barrier 2023-09-19 20:01:54,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:54,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 20:01:54,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 20:01:54,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 20:01:54,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 20:01:54,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-19 20:01:54,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:54,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:54,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:54,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 20:01:54,823 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40397,1695153672742' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-09-19 20:01:54,823 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@8f62028[Count = 0] remaining members to acquire global barrier 2023-09-19 20:01:54,823 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-09-19 20:01:54,823 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-19 20:01:54,824 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-19 20:01:54,824 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-19 20:01:54,824 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-19 20:01:54,825 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-19 20:01:54,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-19 20:01:54,825 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-19 20:01:54,825 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-19 20:01:54,825 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-19 20:01:54,825 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:54,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-19 20:01:54,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-19 20:01:54,825 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-19 20:01:54,825 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-19 20:01:54,825 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,45123,1695153672695' in zk 2023-09-19 20:01:54,825 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-19 20:01:54,825 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:54,825 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-19 20:01:54,825 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-19 20:01:54,825 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-19 20:01:54,825 DEBUG [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1695153714114.3a01b44606d97cb3abc29dca8b01ea0d. 2023-09-19 20:01:54,825 DEBUG [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1695153714114.3a90d9960d6a8e7778815674df3f5bd2. 2023-09-19 20:01:54,826 DEBUG [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1695153714114.3a01b44606d97cb3abc29dca8b01ea0d. started... 2023-09-19 20:01:54,825 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-19 20:01:54,826 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-19 20:01:54,826 DEBUG [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1695153714114.3a90d9960d6a8e7778815674df3f5bd2. started... 2023-09-19 20:01:54,826 DEBUG [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3a01b44606d97cb3abc29dca8b01ea0d: 2023-09-19 20:01:54,827 DEBUG [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3a90d9960d6a8e7778815674df3f5bd2: 2023-09-19 20:01:54,827 DEBUG [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1695153714114.3a01b44606d97cb3abc29dca8b01ea0d.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-19 20:01:54,827 DEBUG [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-19 20:01:54,827 DEBUG [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1695153714114.3a90d9960d6a8e7778815674df3f5bd2.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-19 20:01:54,827 DEBUG [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-19 20:01:54,828 DEBUG [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-19 20:01:54,828 DEBUG [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-19 20:01:54,835 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-19 20:01:54,835 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 20:01:54,835 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-19 20:01:54,841 DEBUG [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1695153714114.3a90d9960d6a8e7778815674df3f5bd2. completed. 2023-09-19 20:01:54,841 DEBUG [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1695153714114.3a90d9960d6a8e7778815674df3f5bd2. 2023-09-19 20:01:54,841 DEBUG [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1695153714114.3a01b44606d97cb3abc29dca8b01ea0d. completed. 2023-09-19 20:01:54,841 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-19 20:01:54,842 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-19 20:01:54,842 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:54,842 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-19 20:01:54,842 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,40397,1695153672742' in zk 2023-09-19 20:01:54,842 DEBUG [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1695153714114.3a01b44606d97cb3abc29dca8b01ea0d. 2023-09-19 20:01:54,842 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-19 20:01:54,842 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-19 20:01:54,842 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:54,842 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-19 20:01:54,842 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,40839,1695153672784' in zk 2023-09-19 20:01:54,843 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-19 20:01:54,843 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:54,843 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 20:01:54,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:54,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 20:01:54,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 20:01:54,843 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-19 20:01:54,845 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:54,845 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-19 20:01:54,845 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 20:01:54,845 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-19 20:01:54,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 20:01:54,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 20:01:54,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-19 20:01:54,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:54,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:54,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:54,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 20:01:54,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-19 20:01:54,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:54,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:54,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:54,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,40397,1695153672742': 2023-09-19 20:01:54,850 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40397,1695153672742' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-09-19 20:01:54,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:54,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 20:01:54,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 20:01:54,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 20:01:54,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 20:01:54,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-19 20:01:54,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:54,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:54,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:54,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 20:01:54,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-19 20:01:54,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:54,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:54,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:54,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,40839,1695153672784': 2023-09-19 20:01:54,853 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40839,1695153672784' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-09-19 20:01:54,853 INFO [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-09-19 20:01:54,853 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-19 20:01:54,853 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-19 20:01:54,853 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-09-19 20:01:54,853 INFO [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-19 20:01:54,854 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-19 20:01:54,854 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-19 20:01:54,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-19 20:01:54,854 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-19 20:01:54,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 20:01:54,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 20:01:54,854 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 20:01:54,854 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-19 20:01:54,854 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-19 20:01:54,855 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 20:01:54,855 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 20:01:54,855 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-19 20:01:54,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-19 20:01:54,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 20:01:54,855 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-19 20:01:54,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-19 20:01:54,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-19 20:01:54,855 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:54,855 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 20:01:54,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 20:01:54,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-19 20:01:54,855 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 20:01:54,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 20:01:54,855 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 20:01:54,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 20:01:54,855 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:54,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-19 20:01:54,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-19 20:01:54,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 20:01:54,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-19 20:01:54,856 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:54,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-19 20:01:54,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:54,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:54,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:54,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 20:01:54,858 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:54,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-19 20:01:54,858 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:54,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:54,858 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:54,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:54,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:54,864 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:54,864 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-19 20:01:54,864 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 20:01:54,864 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:54,864 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 20:01:54,864 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 20:01:54,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 20:01:54,864 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:54,864 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 20:01:54,864 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-09-19 20:01:54,864 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 20:01:54,864 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-09-19 20:01:54,864 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 20:01:54,864 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 20:01:54,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 20:01:54,864 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-19 20:01:54,864 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 20:01:54,864 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 20:01:54,864 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-19 20:01:54,864 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 20:01:54,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 20:01:54,864 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 20:01:54,866 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:54,864 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-19 20:01:54,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 20:01:54,866 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-19 20:01:54,866 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:54,866 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 20:01:54,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 20:01:54,866 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:54,866 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 20:01:54,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 20:01:54,866 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-19 20:01:54,866 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-19 20:01:54,867 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-19 20:01:54,874 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-09-19 20:01:54,875 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-19 20:01:54,885 DEBUG [Listener at jenkins-hbase4.apache.org/45213] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-19 20:01:54,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-19 20:01:54,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-09-19 20:01:54,887 DEBUG [Listener at jenkins-hbase4.apache.org/45213] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-19 20:01:54,893 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-09-19 20:01:54,894 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-09-19 20:01:54,894 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-19 20:01:54,894 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-19 20:01:54,894 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1695153714784Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1695153714874 (+90 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1695153714874Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1695153714874Writing data manifest for emptySnaptb0-testConsecutiveExports at 1695153714877 (+3 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1695153714887 (+10 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1695153714894 (+7 ms) 2023-09-19 20:01:54,897 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-19 20:01:54,899 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 112 msec 2023-09-19 20:01:55,087 DEBUG [Listener at jenkins-hbase4.apache.org/45213] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-19 20:01:55,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-19 20:01:55,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-19 20:01:55,091 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40839] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1695153714114.3a01b44606d97cb3abc29dca8b01ea0d. with WAL disabled. Data may be lost in the event of a crash. 2023-09-19 20:01:55,093 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40397] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1695153714114.3a90d9960d6a8e7778815674df3f5bd2. with WAL disabled. Data may be lost in the event of a crash. 2023-09-19 20:01:55,096 DEBUG [Listener at jenkins-hbase4.apache.org/45213] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-09-19 20:01:55,096 DEBUG [Listener at jenkins-hbase4.apache.org/45213] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1695153714114.3a01b44606d97cb3abc29dca8b01ea0d. 2023-09-19 20:01:55,097 INFO [Listener at jenkins-hbase4.apache.org/45213] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-19 20:01:55,107 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-19 20:01:55,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695153715107 (current time:1695153715107). 2023-09-19 20:01:55,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-19 20:01:55,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] zookeeper.ReadOnlyZKClient(139): Connect 0x44487034 to 127.0.0.1:60323 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-19 20:01:55,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6ba0d9dc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-19 20:01:55,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 20:01:55,122 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40122, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 20:01:55,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x44487034 to 127.0.0.1:60323 2023-09-19 20:01:55,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 20:01:55,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] zookeeper.ReadOnlyZKClient(139): Connect 0x3562e9f7 to 127.0.0.1:60323 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-19 20:01:55,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@32acf6bf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-19 20:01:55,138 DEBUG [hconnection-0x5fafa70f-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 20:01:55,142 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40130, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 20:01:55,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 20:01:55,148 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52978, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 20:01:55,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3562e9f7 to 127.0.0.1:60323 2023-09-19 20:01:55,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 20:01:55,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-19 20:01:55,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-19 20:01:55,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-19 20:01:55,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] procedure2.ProcedureExecutor(1028): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-19 20:01:55,155 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-19 20:01:55,156 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1695154315156 2023-09-19 20:01:55,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-19 20:01:55,156 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-09-19 20:01:55,157 DEBUG [Listener at jenkins-hbase4.apache.org/45213] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-19 20:01:55,157 DEBUG [Listener at jenkins-hbase4.apache.org/45213] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-19 20:01:55,161 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-19 20:01:55,161 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-19 20:01:55,162 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 8 msec 2023-09-19 20:01:55,163 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-19 20:01:55,163 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1695154315163 2023-09-19 20:01:55,174 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-09-19 20:01:55,174 INFO [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-09-19 20:01:55,174 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 20:01:55,175 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-09-19 20:01:55,175 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-09-19 20:01:55,176 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-19 20:01:55,176 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-19 20:01:55,177 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:55,178 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 20:01:55,178 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 20:01:55,178 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 20:01:55,178 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 20:01:55,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 20:01:55,178 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 20:01:55,178 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:55,178 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 20:01:55,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 20:01:55,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 20:01:55,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-19 20:01:55,178 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:55,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-19 20:01:55,178 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-19 20:01:55,178 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:55,178 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-19 20:01:55,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-19 20:01:55,179 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-19 20:01:55,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-19 20:01:55,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-19 20:01:55,179 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-19 20:01:55,179 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-19 20:01:55,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-19 20:01:55,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-19 20:01:55,179 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-19 20:01:55,179 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-19 20:01:55,179 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-19 20:01:55,179 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 20:01:55,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-19 20:01:55,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-19 20:01:55,181 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-19 20:01:55,181 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-19 20:01:55,181 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-19 20:01:55,181 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-19 20:01:55,181 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 20:01:55,181 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-19 20:01:55,181 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40839,1695153672784' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-19 20:01:55,182 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-19 20:01:55,182 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-19 20:01:55,182 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-19 20:01:55,182 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45123,1695153672695' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-19 20:01:55,182 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-19 20:01:55,182 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 20:01:55,183 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-19 20:01:55,183 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-19 20:01:55,183 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40397,1695153672742' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-19 20:01:55,185 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-19 20:01:55,185 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:55,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:55,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 20:01:55,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 20:01:55,185 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-19 20:01:55,187 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:55,187 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-19 20:01:55,187 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-19 20:01:55,187 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 20:01:55,187 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-19 20:01:55,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 20:01:55,187 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 20:01:55,188 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-19 20:01:55,188 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 20:01:55,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 20:01:55,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-19 20:01:55,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:55,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:55,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:55,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 20:01:55,189 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40839,1695153672784' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-09-19 20:01:55,190 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@24d67560[Count = 1] remaining members to acquire global barrier 2023-09-19 20:01:55,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:55,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 20:01:55,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 20:01:55,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 20:01:55,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 20:01:55,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-19 20:01:55,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:55,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:55,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:55,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 20:01:55,192 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40397,1695153672742' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-09-19 20:01:55,192 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@24d67560[Count = 0] remaining members to acquire global barrier 2023-09-19 20:01:55,192 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-09-19 20:01:55,192 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-19 20:01:55,193 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-19 20:01:55,193 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-19 20:01:55,193 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-19 20:01:55,193 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-19 20:01:55,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-19 20:01:55,193 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-19 20:01:55,193 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-19 20:01:55,193 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-19 20:01:55,193 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:55,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-19 20:01:55,193 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-19 20:01:55,193 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-19 20:01:55,194 DEBUG [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1695153714114.3a01b44606d97cb3abc29dca8b01ea0d. 2023-09-19 20:01:55,194 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-19 20:01:55,194 DEBUG [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1695153714114.3a01b44606d97cb3abc29dca8b01ea0d. started... 2023-09-19 20:01:55,194 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-19 20:01:55,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-19 20:01:55,194 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:55,194 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-19 20:01:55,194 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,45123,1695153672695' in zk 2023-09-19 20:01:55,194 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-19 20:01:55,194 INFO [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 3a01b44606d97cb3abc29dca8b01ea0d 1/1 column families, dataSize=199 B heapSize=688 B 2023-09-19 20:01:55,194 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-19 20:01:55,194 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-19 20:01:55,194 DEBUG [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1695153714114.3a90d9960d6a8e7778815674df3f5bd2. 2023-09-19 20:01:55,194 DEBUG [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1695153714114.3a90d9960d6a8e7778815674df3f5bd2. started... 2023-09-19 20:01:55,195 INFO [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 3a90d9960d6a8e7778815674df3f5bd2 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-09-19 20:01:55,196 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-19 20:01:55,196 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 20:01:55,196 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-19 20:01:55,222 INFO [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023091983713586ef1d4382aea04912484315cf to hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023091983713586ef1d4382aea04912484315cf 2023-09-19 20:01:55,223 INFO [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202309192874c045b557467ea3a709796c505823 to hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202309192874c045b557467ea3a709796c505823 2023-09-19 20:01:55,239 INFO [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testConsecutiveExports/3a01b44606d97cb3abc29dca8b01ea0d/.tmp/cf/e20edd2877f1436f88441e02f17f02d5 2023-09-19 20:01:55,240 INFO [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testConsecutiveExports/3a90d9960d6a8e7778815674df3f5bd2/.tmp/cf/78e7dbf3d9fd4937933a3ac1f9a234f3 2023-09-19 20:01:55,245 DEBUG [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testConsecutiveExports/3a01b44606d97cb3abc29dca8b01ea0d/.tmp/cf/e20edd2877f1436f88441e02f17f02d5 as hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testConsecutiveExports/3a01b44606d97cb3abc29dca8b01ea0d/cf/e20edd2877f1436f88441e02f17f02d5 2023-09-19 20:01:55,245 DEBUG [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testConsecutiveExports/3a90d9960d6a8e7778815674df3f5bd2/.tmp/cf/78e7dbf3d9fd4937933a3ac1f9a234f3 as hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testConsecutiveExports/3a90d9960d6a8e7778815674df3f5bd2/cf/78e7dbf3d9fd4937933a3ac1f9a234f3 2023-09-19 20:01:55,250 INFO [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testConsecutiveExports/3a01b44606d97cb3abc29dca8b01ea0d/cf/e20edd2877f1436f88441e02f17f02d5, entries=3, sequenceid=6, filesize=5.4 K 2023-09-19 20:01:55,251 INFO [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testConsecutiveExports/3a90d9960d6a8e7778815674df3f5bd2/cf/78e7dbf3d9fd4937933a3ac1f9a234f3, entries=47, sequenceid=6, filesize=12.7 K 2023-09-19 20:01:55,251 INFO [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 3a01b44606d97cb3abc29dca8b01ea0d in 57ms, sequenceid=6, compaction requested=false 2023-09-19 20:01:55,251 DEBUG [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-09-19 20:01:55,252 INFO [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 3a90d9960d6a8e7778815674df3f5bd2 in 57ms, sequenceid=6, compaction requested=false 2023-09-19 20:01:55,252 DEBUG [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-09-19 20:01:55,253 DEBUG [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3a01b44606d97cb3abc29dca8b01ea0d: 2023-09-19 20:01:55,253 DEBUG [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3a90d9960d6a8e7778815674df3f5bd2: 2023-09-19 20:01:55,254 DEBUG [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1695153714114.3a01b44606d97cb3abc29dca8b01ea0d.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-19 20:01:55,254 DEBUG [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-19 20:01:55,254 DEBUG [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1695153714114.3a90d9960d6a8e7778815674df3f5bd2.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-19 20:01:55,254 DEBUG [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testConsecutiveExports/3a01b44606d97cb3abc29dca8b01ea0d/cf/e20edd2877f1436f88441e02f17f02d5] hfiles 2023-09-19 20:01:55,254 DEBUG [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-19 20:01:55,254 DEBUG [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testConsecutiveExports/3a01b44606d97cb3abc29dca8b01ea0d/cf/e20edd2877f1436f88441e02f17f02d5 for snapshot=snaptb0-testConsecutiveExports 2023-09-19 20:01:55,254 DEBUG [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testConsecutiveExports/3a90d9960d6a8e7778815674df3f5bd2/cf/78e7dbf3d9fd4937933a3ac1f9a234f3] hfiles 2023-09-19 20:01:55,254 DEBUG [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testConsecutiveExports/3a90d9960d6a8e7778815674df3f5bd2/cf/78e7dbf3d9fd4937933a3ac1f9a234f3 for snapshot=snaptb0-testConsecutiveExports 2023-09-19 20:01:55,257 DEBUG [Listener at jenkins-hbase4.apache.org/45213] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-19 20:01:55,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-19 20:01:55,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-09-19 20:01:55,259 DEBUG [Listener at jenkins-hbase4.apache.org/45213] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-19 20:01:55,272 DEBUG [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1695153714114.3a90d9960d6a8e7778815674df3f5bd2. completed. 2023-09-19 20:01:55,272 DEBUG [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1695153714114.3a90d9960d6a8e7778815674df3f5bd2. 2023-09-19 20:01:55,272 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-19 20:01:55,272 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-19 20:01:55,272 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:55,272 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-19 20:01:55,273 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,40397,1695153672742' in zk 2023-09-19 20:01:55,274 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-19 20:01:55,275 DEBUG [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1695153714114.3a01b44606d97cb3abc29dca8b01ea0d. completed. 2023-09-19 20:01:55,274 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:55,275 DEBUG [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1695153714114.3a01b44606d97cb3abc29dca8b01ea0d. 2023-09-19 20:01:55,275 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 20:01:55,275 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-19 20:01:55,276 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-19 20:01:55,276 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:55,275 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-19 20:01:55,276 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-19 20:01:55,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:55,277 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,40839,1695153672784' in zk 2023-09-19 20:01:55,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 20:01:55,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 20:01:55,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 20:01:55,279 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:55,279 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-19 20:01:55,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 20:01:55,279 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 20:01:55,279 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-19 20:01:55,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-19 20:01:55,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:55,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:55,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:55,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 20:01:55,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-19 20:01:55,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:55,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:55,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:55,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,40397,1695153672742': 2023-09-19 20:01:55,284 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40397,1695153672742' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-09-19 20:01:55,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:55,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 20:01:55,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 20:01:55,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 20:01:55,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 20:01:55,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-19 20:01:55,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:55,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:55,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:55,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 20:01:55,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-19 20:01:55,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:55,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:55,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:55,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,40839,1695153672784': 2023-09-19 20:01:55,287 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40839,1695153672784' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-09-19 20:01:55,287 INFO [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-09-19 20:01:55,287 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-19 20:01:55,287 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-19 20:01:55,287 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-09-19 20:01:55,287 INFO [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-19 20:01:55,289 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-19 20:01:55,289 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-19 20:01:55,289 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-19 20:01:55,289 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-19 20:01:55,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-19 20:01:55,289 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 20:01:55,289 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 20:01:55,289 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-19 20:01:55,289 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-19 20:01:55,289 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-19 20:01:55,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-19 20:01:55,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 20:01:55,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 20:01:55,290 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 20:01:55,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 20:01:55,289 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 20:01:55,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-19 20:01:55,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-19 20:01:55,290 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:55,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 20:01:55,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-19 20:01:55,290 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 20:01:55,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 20:01:55,290 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:55,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-19 20:01:55,291 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 20:01:55,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 20:01:55,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-19 20:01:55,291 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:55,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 20:01:55,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-19 20:01:55,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-19 20:01:55,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:55,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:55,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:55,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 20:01:55,293 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:55,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-19 20:01:55,293 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:55,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:55,293 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:55,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:55,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:55,301 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 20:01:55,301 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 20:01:55,301 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 20:01:55,301 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 20:01:55,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 20:01:55,301 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 20:01:55,301 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 20:01:55,301 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 20:01:55,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 20:01:55,301 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-09-19 20:01:55,301 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-09-19 20:01:55,301 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 20:01:55,301 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:55,301 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 20:01:55,302 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-19 20:01:55,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 20:01:55,301 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-19 20:01:55,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 20:01:55,301 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 20:01:55,302 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-19 20:01:55,301 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 20:01:55,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 20:01:55,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 20:01:55,302 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:55,304 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:55,304 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-19 20:01:55,304 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:01:55,304 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-19 20:01:55,304 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:01:55,304 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:01:55,304 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-19 20:01:55,304 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-19 20:01:55,305 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 20:01:55,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 20:01:55,305 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202309192874c045b557467ea3a709796c505823, hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023091983713586ef1d4382aea04912484315cf] mob files 2023-09-19 20:01:55,305 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202309192874c045b557467ea3a709796c505823 2023-09-19 20:01:55,305 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023091983713586ef1d4382aea04912484315cf 2023-09-19 20:01:55,314 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-09-19 20:01:55,315 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-19 20:01:55,338 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-19 20:01:55,338 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-09-19 20:01:55,339 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-19 20:01:55,339 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-19 20:01:55,339 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1695153715156Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1695153715314 (+158 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1695153715314Loading Region manifests for snaptb0-testConsecutiveExports at 1695153715314Writing data manifest for snaptb0-testConsecutiveExports at 1695153715318 (+4 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1695153715329 (+11 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1695153715338 (+9 ms) 2023-09-19 20:01:55,342 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-19 20:01:55,344 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 185 msec 2023-09-19 20:01:55,459 DEBUG [Listener at jenkins-hbase4.apache.org/45213] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-19 20:01:55,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-19 20:01:55,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-19 20:01:55,461 INFO [Listener at jenkins-hbase4.apache.org/45213] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59/local-export-1695153715461 2023-09-19 20:01:55,461 INFO [Listener at jenkins-hbase4.apache.org/45213] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59/local-export-1695153715461, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59/local-export-1695153715461, srcFsUri=hdfs://localhost:38739, srcDir=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf 2023-09-19 20:01:55,483 DEBUG [Listener at jenkins-hbase4.apache.org/45213] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:38739, inputRoot=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf 2023-09-19 20:01:55,483 DEBUG [Listener at jenkins-hbase4.apache.org/45213] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@39ca1624, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59/local-export-1695153715461, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59/local-export-1695153715461/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-19 20:01:55,483 INFO [Listener at jenkins-hbase4.apache.org/45213] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:38739, inputRoot=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf, snapshotDir=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-09-19 20:01:55,492 INFO [Listener at jenkins-hbase4.apache.org/45213] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59/local-export-1695153715461/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-19 20:01:55,504 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-19 20:01:55,504 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-19 20:01:55,505 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-19 20:01:55,505 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-19 20:01:56,392 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59/hadoop-9062564193155084640.jar 2023-09-19 20:01:56,393 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-19 20:01:56,393 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-19 20:01:56,463 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59/hadoop-4978158455546147426.jar 2023-09-19 20:01:56,464 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-19 20:01:56,464 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-19 20:01:56,465 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-19 20:01:56,465 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-19 20:01:56,465 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-19 20:01:56,466 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-19 20:01:56,466 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-19 20:01:56,466 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-19 20:01:56,467 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-19 20:01:56,467 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-19 20:01:56,468 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-19 20:01:56,468 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-19 20:01:56,469 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-19 20:01:56,469 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-19 20:01:56,469 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-19 20:01:56,470 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-19 20:01:56,471 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-19 20:01:56,471 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-19 20:01:56,472 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-19 20:01:56,472 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-19 20:01:56,472 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-19 20:01:56,472 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-19 20:01:56,473 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-19 20:01:56,867 WARN [Listener at jenkins-hbase4.apache.org/45213] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-19 20:01:56,869 INFO [Listener at jenkins-hbase4.apache.org/45213] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-09-19 20:01:56,872 DEBUG [Listener at jenkins-hbase4.apache.org/45213] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-09-19 20:01:58,189 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-19 20:01:58,189 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-19 20:01:58,192 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695153679175_0002_000001 (auth:SIMPLE) 2023-09-19 20:01:58,982 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695153679175_0003_000001 (auth:SIMPLE) 2023-09-19 20:01:59,394 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-19 20:02:02,711 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695153679175_0003_000001 (auth:SIMPLE) 2023-09-19 20:02:04,937 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695153679175_0003_000001 (auth:SIMPLE) 2023-09-19 20:02:07,250 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695153679175_0003_000001 (auth:SIMPLE) 2023-09-19 20:02:09,030 INFO [Listener at jenkins-hbase4.apache.org/45213] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-19 20:02:09,031 INFO [Listener at jenkins-hbase4.apache.org/45213] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-19 20:02:09,035 INFO [Listener at jenkins-hbase4.apache.org/45213] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-09-19 20:02:09,035 INFO [Listener at jenkins-hbase4.apache.org/45213] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-19 20:02:09,036 INFO [Listener at jenkins-hbase4.apache.org/45213] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-19 20:02:09,036 DEBUG [Listener at jenkins-hbase4.apache.org/45213] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1909323301_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-19 20:02:09,038 DEBUG [Listener at jenkins-hbase4.apache.org/45213] snapshot.TestExportSnapshot(367): hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-19 20:02:09,039 DEBUG [Listener at jenkins-hbase4.apache.org/45213] snapshot.TestExportSnapshot(367): hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-19 20:02:09,039 DEBUG [Listener at jenkins-hbase4.apache.org/45213] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@2125b8c6 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59/local-export-1695153715461/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59/local-export-1695153715461/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-19 20:02:09,039 DEBUG [Listener at jenkins-hbase4.apache.org/45213] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59/local-export-1695153715461/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-19 20:02:09,039 DEBUG [Listener at jenkins-hbase4.apache.org/45213] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59/local-export-1695153715461/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-19 20:02:09,040 INFO [Listener at jenkins-hbase4.apache.org/45213] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59/local-export-1695153715461, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59/local-export-1695153715461, srcFsUri=hdfs://localhost:38739, srcDir=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf 2023-09-19 20:02:09,062 DEBUG [Listener at jenkins-hbase4.apache.org/45213] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:38739, inputRoot=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf 2023-09-19 20:02:09,062 DEBUG [Listener at jenkins-hbase4.apache.org/45213] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@267bdb26, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59/local-export-1695153715461, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59/local-export-1695153715461/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-19 20:02:09,062 INFO [Listener at jenkins-hbase4.apache.org/45213] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:38739, inputRoot=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf, snapshotDir=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-09-19 20:02:09,074 INFO [Listener at jenkins-hbase4.apache.org/45213] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59/local-export-1695153715461/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-19 20:02:09,085 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-19 20:02:09,085 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-19 20:02:09,086 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-19 20:02:09,086 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-19 20:02:09,958 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59/hadoop-6811191790438130001.jar 2023-09-19 20:02:09,959 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-19 20:02:09,959 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-19 20:02:10,026 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59/hadoop-6563002207123935737.jar 2023-09-19 20:02:10,026 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-19 20:02:10,027 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-19 20:02:10,027 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-19 20:02:10,028 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-19 20:02:10,028 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-19 20:02:10,028 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-19 20:02:10,029 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-19 20:02:10,029 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-19 20:02:10,029 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-19 20:02:10,030 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-19 20:02:10,030 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-19 20:02:10,031 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-19 20:02:10,031 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-19 20:02:10,031 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-19 20:02:10,032 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-19 20:02:10,032 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-19 20:02:10,033 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-19 20:02:10,033 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-19 20:02:10,034 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-19 20:02:10,034 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-19 20:02:10,034 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-19 20:02:10,035 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-19 20:02:10,035 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-19 20:02:10,399 WARN [Listener at jenkins-hbase4.apache.org/45213] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-19 20:02:10,401 INFO [Listener at jenkins-hbase4.apache.org/45213] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-09-19 20:02:10,403 DEBUG [Listener at jenkins-hbase4.apache.org/45213] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-09-19 20:02:13,422 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-19 20:02:13,422 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-19 20:02:13,425 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695153679175_0003_000001 (auth:SIMPLE) 2023-09-19 20:02:14,202 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695153679175_0004_000001 (auth:SIMPLE) 2023-09-19 20:02:17,828 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695153679175_0004_000001 (auth:SIMPLE) 2023-09-19 20:02:20,047 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695153679175_0004_000001 (auth:SIMPLE) 2023-09-19 20:02:22,268 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695153679175_0004_000001 (auth:SIMPLE) 2023-09-19 20:02:23,562 INFO [Listener at jenkins-hbase4.apache.org/45213] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-19 20:02:23,562 INFO [Listener at jenkins-hbase4.apache.org/45213] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-19 20:02:23,566 INFO [Listener at jenkins-hbase4.apache.org/45213] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-09-19 20:02:23,566 INFO [Listener at jenkins-hbase4.apache.org/45213] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-19 20:02:23,566 INFO [Listener at jenkins-hbase4.apache.org/45213] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-19 20:02:23,566 DEBUG [Listener at jenkins-hbase4.apache.org/45213] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1909323301_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-19 20:02:23,570 DEBUG [Listener at jenkins-hbase4.apache.org/45213] snapshot.TestExportSnapshot(367): hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-19 20:02:23,570 DEBUG [Listener at jenkins-hbase4.apache.org/45213] snapshot.TestExportSnapshot(367): hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-19 20:02:23,570 DEBUG [Listener at jenkins-hbase4.apache.org/45213] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@2125b8c6 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59/local-export-1695153715461/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59/local-export-1695153715461/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-19 20:02:23,570 DEBUG [Listener at jenkins-hbase4.apache.org/45213] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59/local-export-1695153715461/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-19 20:02:23,571 DEBUG [Listener at jenkins-hbase4.apache.org/45213] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59/local-export-1695153715461/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-19 20:02:23,583 INFO [Listener at jenkins-hbase4.apache.org/45213] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-09-19 20:02:23,583 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-09-19 20:02:23,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] procedure2.ProcedureExecutor(1028): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-09-19 20:02:23,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-19 20:02:23,588 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695153743588"}]},"ts":"1695153743588"} 2023-09-19 20:02:23,590 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-09-19 20:02:23,591 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-09-19 20:02:23,592 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=3a01b44606d97cb3abc29dca8b01ea0d, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=3a90d9960d6a8e7778815674df3f5bd2, UNASSIGN}] 2023-09-19 20:02:23,594 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=3a01b44606d97cb3abc29dca8b01ea0d, UNASSIGN 2023-09-19 20:02:23,594 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=3a90d9960d6a8e7778815674df3f5bd2, UNASSIGN 2023-09-19 20:02:23,595 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=3a01b44606d97cb3abc29dca8b01ea0d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:23,595 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=3a90d9960d6a8e7778815674df3f5bd2, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:23,595 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1695153714114.3a01b44606d97cb3abc29dca8b01ea0d.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695153743595"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695153743595"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695153743595"}]},"ts":"1695153743595"} 2023-09-19 20:02:23,595 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1695153714114.3a90d9960d6a8e7778815674df3f5bd2.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695153743595"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695153743595"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695153743595"}]},"ts":"1695153743595"} 2023-09-19 20:02:23,596 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=54, ppid=52, state=RUNNABLE; CloseRegionProcedure 3a01b44606d97cb3abc29dca8b01ea0d, server=jenkins-hbase4.apache.org,40839,1695153672784}] 2023-09-19 20:02:23,597 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=55, ppid=53, state=RUNNABLE; CloseRegionProcedure 3a90d9960d6a8e7778815674df3f5bd2, server=jenkins-hbase4.apache.org,40397,1695153672742}] 2023-09-19 20:02:23,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-19 20:02:23,749 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 3a01b44606d97cb3abc29dca8b01ea0d 2023-09-19 20:02:23,749 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 3a01b44606d97cb3abc29dca8b01ea0d, disabling compactions & flushes 2023-09-19 20:02:23,749 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1695153714114.3a01b44606d97cb3abc29dca8b01ea0d. 2023-09-19 20:02:23,749 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1695153714114.3a01b44606d97cb3abc29dca8b01ea0d. 2023-09-19 20:02:23,749 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1695153714114.3a01b44606d97cb3abc29dca8b01ea0d. after waiting 0 ms 2023-09-19 20:02:23,749 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1695153714114.3a01b44606d97cb3abc29dca8b01ea0d. 2023-09-19 20:02:23,750 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 3a90d9960d6a8e7778815674df3f5bd2 2023-09-19 20:02:23,753 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 3a90d9960d6a8e7778815674df3f5bd2, disabling compactions & flushes 2023-09-19 20:02:23,753 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1695153714114.3a90d9960d6a8e7778815674df3f5bd2. 2023-09-19 20:02:23,753 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1695153714114.3a90d9960d6a8e7778815674df3f5bd2. 2023-09-19 20:02:23,753 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1695153714114.3a90d9960d6a8e7778815674df3f5bd2. after waiting 0 ms 2023-09-19 20:02:23,753 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1695153714114.3a90d9960d6a8e7778815674df3f5bd2. 2023-09-19 20:02:23,763 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testConsecutiveExports/3a01b44606d97cb3abc29dca8b01ea0d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-19 20:02:23,763 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testConsecutiveExports/3a90d9960d6a8e7778815674df3f5bd2/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-19 20:02:23,764 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-19 20:02:23,764 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-19 20:02:23,765 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1695153714114.3a01b44606d97cb3abc29dca8b01ea0d. 2023-09-19 20:02:23,766 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1695153714114.3a90d9960d6a8e7778815674df3f5bd2. 2023-09-19 20:02:23,766 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 3a01b44606d97cb3abc29dca8b01ea0d: 2023-09-19 20:02:23,766 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 3a90d9960d6a8e7778815674df3f5bd2: 2023-09-19 20:02:23,767 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 3a01b44606d97cb3abc29dca8b01ea0d 2023-09-19 20:02:23,768 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=3a01b44606d97cb3abc29dca8b01ea0d, regionState=CLOSED 2023-09-19 20:02:23,768 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 3a90d9960d6a8e7778815674df3f5bd2 2023-09-19 20:02:23,768 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1695153714114.3a01b44606d97cb3abc29dca8b01ea0d.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695153743768"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695153743768"}]},"ts":"1695153743768"} 2023-09-19 20:02:23,768 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=3a90d9960d6a8e7778815674df3f5bd2, regionState=CLOSED 2023-09-19 20:02:23,768 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1695153714114.3a90d9960d6a8e7778815674df3f5bd2.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695153743768"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695153743768"}]},"ts":"1695153743768"} 2023-09-19 20:02:23,771 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=54, resume processing ppid=52 2023-09-19 20:02:23,771 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=54, ppid=52, state=SUCCESS; CloseRegionProcedure 3a01b44606d97cb3abc29dca8b01ea0d, server=jenkins-hbase4.apache.org,40839,1695153672784 in 173 msec 2023-09-19 20:02:23,772 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=55, resume processing ppid=53 2023-09-19 20:02:23,772 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=55, ppid=53, state=SUCCESS; CloseRegionProcedure 3a90d9960d6a8e7778815674df3f5bd2, server=jenkins-hbase4.apache.org,40397,1695153672742 in 173 msec 2023-09-19 20:02:23,772 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=3a01b44606d97cb3abc29dca8b01ea0d, UNASSIGN in 179 msec 2023-09-19 20:02:23,773 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=53, resume processing ppid=51 2023-09-19 20:02:23,773 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=3a90d9960d6a8e7778815674df3f5bd2, UNASSIGN in 180 msec 2023-09-19 20:02:23,774 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695153743774"}]},"ts":"1695153743774"} 2023-09-19 20:02:23,775 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-09-19 20:02:23,777 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-09-19 20:02:23,779 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 194 msec 2023-09-19 20:02:23,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-19 20:02:23,890 INFO [Listener at jenkins-hbase4.apache.org/45213] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-09-19 20:02:23,891 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-09-19 20:02:23,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] procedure2.ProcedureExecutor(1028): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-19 20:02:23,894 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-19 20:02:23,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-09-19 20:02:23,895 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-19 20:02:23,899 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40839] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-09-19 20:02:23,903 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-19 20:02:23,903 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-19 20:02:23,903 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-19 20:02:23,903 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-19 20:02:23,903 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testConsecutiveExports/3a01b44606d97cb3abc29dca8b01ea0d 2023-09-19 20:02:23,903 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-19 20:02:23,903 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testConsecutiveExports/3a90d9960d6a8e7778815674df3f5bd2 2023-09-19 20:02:23,903 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-19 20:02:23,903 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-19 20:02:23,903 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-19 20:02:23,904 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-19 20:02:23,904 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-19 20:02:23,904 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 20:02:23,904 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-19 20:02:23,904 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 20:02:23,904 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-19 20:02:23,904 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 20:02:23,904 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 20:02:23,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-09-19 20:02:23,906 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testConsecutiveExports/3a90d9960d6a8e7778815674df3f5bd2/cf, FileablePath, hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testConsecutiveExports/3a90d9960d6a8e7778815674df3f5bd2/recovered.edits] 2023-09-19 20:02:23,906 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testConsecutiveExports/3a01b44606d97cb3abc29dca8b01ea0d/cf, FileablePath, hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testConsecutiveExports/3a01b44606d97cb3abc29dca8b01ea0d/recovered.edits] 2023-09-19 20:02:23,910 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testConsecutiveExports/3a01b44606d97cb3abc29dca8b01ea0d/cf/e20edd2877f1436f88441e02f17f02d5 to hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/archive/data/default/testtb-testConsecutiveExports/3a01b44606d97cb3abc29dca8b01ea0d/cf/e20edd2877f1436f88441e02f17f02d5 2023-09-19 20:02:23,910 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testConsecutiveExports/3a90d9960d6a8e7778815674df3f5bd2/cf/78e7dbf3d9fd4937933a3ac1f9a234f3 to hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/archive/data/default/testtb-testConsecutiveExports/3a90d9960d6a8e7778815674df3f5bd2/cf/78e7dbf3d9fd4937933a3ac1f9a234f3 2023-09-19 20:02:23,913 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testConsecutiveExports/3a01b44606d97cb3abc29dca8b01ea0d/recovered.edits/9.seqid to hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/archive/data/default/testtb-testConsecutiveExports/3a01b44606d97cb3abc29dca8b01ea0d/recovered.edits/9.seqid 2023-09-19 20:02:23,913 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testConsecutiveExports/3a90d9960d6a8e7778815674df3f5bd2/recovered.edits/9.seqid to hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/archive/data/default/testtb-testConsecutiveExports/3a90d9960d6a8e7778815674df3f5bd2/recovered.edits/9.seqid 2023-09-19 20:02:23,914 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testConsecutiveExports/3a01b44606d97cb3abc29dca8b01ea0d 2023-09-19 20:02:23,914 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testConsecutiveExports/3a90d9960d6a8e7778815674df3f5bd2 2023-09-19 20:02:23,914 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-09-19 20:02:23,915 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-09-19 20:02:23,915 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-09-19 20:02:23,919 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202309192874c045b557467ea3a709796c505823 to hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202309192874c045b557467ea3a709796c505823 2023-09-19 20:02:23,920 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023091983713586ef1d4382aea04912484315cf to hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023091983713586ef1d4382aea04912484315cf 2023-09-19 20:02:23,921 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-09-19 20:02:23,923 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-19 20:02:23,925 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-09-19 20:02:23,927 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-09-19 20:02:23,928 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-19 20:02:23,928 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-09-19 20:02:23,929 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1695153714114.3a01b44606d97cb3abc29dca8b01ea0d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695153743929"}]},"ts":"9223372036854775807"} 2023-09-19 20:02:23,929 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1695153714114.3a90d9960d6a8e7778815674df3f5bd2.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695153743929"}]},"ts":"9223372036854775807"} 2023-09-19 20:02:23,930 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-19 20:02:23,931 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 3a01b44606d97cb3abc29dca8b01ea0d, NAME => 'testtb-testConsecutiveExports,,1695153714114.3a01b44606d97cb3abc29dca8b01ea0d.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 3a90d9960d6a8e7778815674df3f5bd2, NAME => 'testtb-testConsecutiveExports,1,1695153714114.3a90d9960d6a8e7778815674df3f5bd2.', STARTKEY => '1', ENDKEY => ''}] 2023-09-19 20:02:23,931 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-09-19 20:02:23,931 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695153743931"}]},"ts":"9223372036854775807"} 2023-09-19 20:02:23,932 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-09-19 20:02:23,934 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-19 20:02:23,935 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 43 msec 2023-09-19 20:02:24,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-09-19 20:02:24,007 INFO [Listener at jenkins-hbase4.apache.org/45213] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-09-19 20:02:24,015 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-09-19 20:02:24,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-09-19 20:02:24,018 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-09-19 20:02:24,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-09-19 20:02:24,042 INFO [Listener at jenkins-hbase4.apache.org/45213] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=752 (was 768), OpenFileDescriptor=908 (was 935), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=243 (was 223) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 169), AvailableMemoryMB=7621 (was 7775) 2023-09-19 20:02:24,043 WARN [Listener at jenkins-hbase4.apache.org/45213] hbase.ResourceChecker(130): Thread=752 is superior to 500 2023-09-19 20:02:24,061 INFO [Listener at jenkins-hbase4.apache.org/45213] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=752, OpenFileDescriptor=908, MaxFileDescriptor=60000, SystemLoadAverage=243, ProcessCount=168, AvailableMemoryMB=7621 2023-09-19 20:02:24,061 WARN [Listener at jenkins-hbase4.apache.org/45213] hbase.ResourceChecker(130): Thread=752 is superior to 500 2023-09-19 20:02:24,063 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-19 20:02:24,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] procedure2.ProcedureExecutor(1028): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,066 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-09-19 20:02:24,066 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-09-19 20:02:24,067 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-19 20:02:24,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-19 20:02:24,069 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c9697c82f09580ee877f816315a7110a 2023-09-19 20:02:24,069 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/21d5efa9d832e0188c4afe38817df632 2023-09-19 20:02:24,070 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c9697c82f09580ee877f816315a7110a empty. 2023-09-19 20:02:24,070 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/21d5efa9d832e0188c4afe38817df632 empty. 2023-09-19 20:02:24,070 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c9697c82f09580ee877f816315a7110a 2023-09-19 20:02:24,070 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/21d5efa9d832e0188c4afe38817df632 2023-09-19 20:02:24,070 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-09-19 20:02:24,079 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-09-19 20:02:24,081 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => c9697c82f09580ee877f816315a7110a, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1695153744062.c9697c82f09580ee877f816315a7110a.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp 2023-09-19 20:02:24,081 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 21d5efa9d832e0188c4afe38817df632, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1695153744062.21d5efa9d832e0188c4afe38817df632.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp 2023-09-19 20:02:24,090 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1695153744062.c9697c82f09580ee877f816315a7110a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 20:02:24,091 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing c9697c82f09580ee877f816315a7110a, disabling compactions & flushes 2023-09-19 20:02:24,091 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1695153744062.c9697c82f09580ee877f816315a7110a. 2023-09-19 20:02:24,091 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695153744062.c9697c82f09580ee877f816315a7110a. 2023-09-19 20:02:24,091 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695153744062.c9697c82f09580ee877f816315a7110a. after waiting 0 ms 2023-09-19 20:02:24,091 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1695153744062.c9697c82f09580ee877f816315a7110a. 2023-09-19 20:02:24,091 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1695153744062.c9697c82f09580ee877f816315a7110a. 2023-09-19 20:02:24,091 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for c9697c82f09580ee877f816315a7110a: 2023-09-19 20:02:24,094 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1695153744062.21d5efa9d832e0188c4afe38817df632.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 20:02:24,094 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 21d5efa9d832e0188c4afe38817df632, disabling compactions & flushes 2023-09-19 20:02:24,094 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1695153744062.21d5efa9d832e0188c4afe38817df632. 2023-09-19 20:02:24,094 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695153744062.21d5efa9d832e0188c4afe38817df632. 2023-09-19 20:02:24,094 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695153744062.21d5efa9d832e0188c4afe38817df632. after waiting 0 ms 2023-09-19 20:02:24,094 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1695153744062.21d5efa9d832e0188c4afe38817df632. 2023-09-19 20:02:24,094 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1695153744062.21d5efa9d832e0188c4afe38817df632. 2023-09-19 20:02:24,094 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 21d5efa9d832e0188c4afe38817df632: 2023-09-19 20:02:24,096 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-09-19 20:02:24,097 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695153744062.c9697c82f09580ee877f816315a7110a.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695153744097"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695153744097"}]},"ts":"1695153744097"} 2023-09-19 20:02:24,097 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695153744062.21d5efa9d832e0188c4afe38817df632.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695153744097"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695153744097"}]},"ts":"1695153744097"} 2023-09-19 20:02:24,103 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-19 20:02:24,104 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-19 20:02:24,104 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695153744104"}]},"ts":"1695153744104"} 2023-09-19 20:02:24,105 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-09-19 20:02:24,110 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-19 20:02:24,111 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-19 20:02:24,111 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-19 20:02:24,111 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-19 20:02:24,111 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-19 20:02:24,111 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c9697c82f09580ee877f816315a7110a, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=21d5efa9d832e0188c4afe38817df632, ASSIGN}] 2023-09-19 20:02:24,114 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=21d5efa9d832e0188c4afe38817df632, ASSIGN 2023-09-19 20:02:24,114 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c9697c82f09580ee877f816315a7110a, ASSIGN 2023-09-19 20:02:24,114 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=21d5efa9d832e0188c4afe38817df632, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40839,1695153672784; forceNewPlan=false, retain=false 2023-09-19 20:02:24,115 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c9697c82f09580ee877f816315a7110a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40397,1695153672742; forceNewPlan=false, retain=false 2023-09-19 20:02:24,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-19 20:02:24,265 INFO [jenkins-hbase4:37929] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-19 20:02:24,267 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=21d5efa9d832e0188c4afe38817df632, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:24,267 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=c9697c82f09580ee877f816315a7110a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:24,268 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695153744062.21d5efa9d832e0188c4afe38817df632.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695153744267"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695153744267"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695153744267"}]},"ts":"1695153744267"} 2023-09-19 20:02:24,268 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695153744062.c9697c82f09580ee877f816315a7110a.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695153744267"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695153744267"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695153744267"}]},"ts":"1695153744267"} 2023-09-19 20:02:24,269 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure 21d5efa9d832e0188c4afe38817df632, server=jenkins-hbase4.apache.org,40839,1695153672784}] 2023-09-19 20:02:24,273 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure c9697c82f09580ee877f816315a7110a, server=jenkins-hbase4.apache.org,40397,1695153672742}] 2023-09-19 20:02:24,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-19 20:02:24,427 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1695153744062.21d5efa9d832e0188c4afe38817df632. 2023-09-19 20:02:24,427 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 21d5efa9d832e0188c4afe38817df632, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1695153744062.21d5efa9d832e0188c4afe38817df632.', STARTKEY => '1', ENDKEY => ''} 2023-09-19 20:02:24,428 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1695153744062.21d5efa9d832e0188c4afe38817df632. service=AccessControlService 2023-09-19 20:02:24,428 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1695153744062.c9697c82f09580ee877f816315a7110a. 2023-09-19 20:02:24,428 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c9697c82f09580ee877f816315a7110a, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1695153744062.c9697c82f09580ee877f816315a7110a.', STARTKEY => '', ENDKEY => '1'} 2023-09-19 20:02:24,428 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-19 20:02:24,428 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 21d5efa9d832e0188c4afe38817df632 2023-09-19 20:02:24,428 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1695153744062.c9697c82f09580ee877f816315a7110a. service=AccessControlService 2023-09-19 20:02:24,428 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1695153744062.21d5efa9d832e0188c4afe38817df632.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 20:02:24,428 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 21d5efa9d832e0188c4afe38817df632 2023-09-19 20:02:24,428 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 21d5efa9d832e0188c4afe38817df632 2023-09-19 20:02:24,428 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-19 20:02:24,428 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion c9697c82f09580ee877f816315a7110a 2023-09-19 20:02:24,428 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1695153744062.c9697c82f09580ee877f816315a7110a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 20:02:24,428 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c9697c82f09580ee877f816315a7110a 2023-09-19 20:02:24,428 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c9697c82f09580ee877f816315a7110a 2023-09-19 20:02:24,429 INFO [StoreOpener-21d5efa9d832e0188c4afe38817df632-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 21d5efa9d832e0188c4afe38817df632 2023-09-19 20:02:24,429 INFO [StoreOpener-c9697c82f09580ee877f816315a7110a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c9697c82f09580ee877f816315a7110a 2023-09-19 20:02:24,431 DEBUG [StoreOpener-21d5efa9d832e0188c4afe38817df632-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemStateWithMergeRegion/21d5efa9d832e0188c4afe38817df632/cf 2023-09-19 20:02:24,431 DEBUG [StoreOpener-21d5efa9d832e0188c4afe38817df632-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemStateWithMergeRegion/21d5efa9d832e0188c4afe38817df632/cf 2023-09-19 20:02:24,431 DEBUG [StoreOpener-c9697c82f09580ee877f816315a7110a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemStateWithMergeRegion/c9697c82f09580ee877f816315a7110a/cf 2023-09-19 20:02:24,431 DEBUG [StoreOpener-c9697c82f09580ee877f816315a7110a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemStateWithMergeRegion/c9697c82f09580ee877f816315a7110a/cf 2023-09-19 20:02:24,432 INFO [StoreOpener-c9697c82f09580ee877f816315a7110a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c9697c82f09580ee877f816315a7110a columnFamilyName cf 2023-09-19 20:02:24,432 INFO [StoreOpener-21d5efa9d832e0188c4afe38817df632-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 21d5efa9d832e0188c4afe38817df632 columnFamilyName cf 2023-09-19 20:02:24,433 INFO [StoreOpener-21d5efa9d832e0188c4afe38817df632-1] regionserver.HStore(310): Store=21d5efa9d832e0188c4afe38817df632/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-19 20:02:24,433 INFO [StoreOpener-c9697c82f09580ee877f816315a7110a-1] regionserver.HStore(310): Store=c9697c82f09580ee877f816315a7110a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-19 20:02:24,434 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemStateWithMergeRegion/c9697c82f09580ee877f816315a7110a 2023-09-19 20:02:24,435 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemStateWithMergeRegion/21d5efa9d832e0188c4afe38817df632 2023-09-19 20:02:24,435 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemStateWithMergeRegion/c9697c82f09580ee877f816315a7110a 2023-09-19 20:02:24,435 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemStateWithMergeRegion/21d5efa9d832e0188c4afe38817df632 2023-09-19 20:02:24,438 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c9697c82f09580ee877f816315a7110a 2023-09-19 20:02:24,438 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 21d5efa9d832e0188c4afe38817df632 2023-09-19 20:02:24,440 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemStateWithMergeRegion/c9697c82f09580ee877f816315a7110a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-19 20:02:24,440 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemStateWithMergeRegion/21d5efa9d832e0188c4afe38817df632/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-19 20:02:24,440 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c9697c82f09580ee877f816315a7110a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73562221, jitterRate=0.09616251289844513}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-19 20:02:24,440 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c9697c82f09580ee877f816315a7110a: 2023-09-19 20:02:24,440 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 21d5efa9d832e0188c4afe38817df632; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65935060, jitterRate=-0.017491042613983154}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-19 20:02:24,440 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 21d5efa9d832e0188c4afe38817df632: 2023-09-19 20:02:24,441 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1695153744062.c9697c82f09580ee877f816315a7110a., pid=61, masterSystemTime=1695153744425 2023-09-19 20:02:24,441 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1695153744062.21d5efa9d832e0188c4afe38817df632., pid=60, masterSystemTime=1695153744424 2023-09-19 20:02:24,443 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1695153744062.c9697c82f09580ee877f816315a7110a. 2023-09-19 20:02:24,443 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1695153744062.c9697c82f09580ee877f816315a7110a. 2023-09-19 20:02:24,443 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=c9697c82f09580ee877f816315a7110a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:24,443 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1695153744062.21d5efa9d832e0188c4afe38817df632. 2023-09-19 20:02:24,443 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695153744062.c9697c82f09580ee877f816315a7110a.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695153744443"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695153744443"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695153744443"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695153744443"}]},"ts":"1695153744443"} 2023-09-19 20:02:24,443 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1695153744062.21d5efa9d832e0188c4afe38817df632. 2023-09-19 20:02:24,444 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=21d5efa9d832e0188c4afe38817df632, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:24,444 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695153744062.21d5efa9d832e0188c4afe38817df632.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695153744444"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695153744444"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695153744444"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695153744444"}]},"ts":"1695153744444"} 2023-09-19 20:02:24,447 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=61, resume processing ppid=58 2023-09-19 20:02:24,447 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure c9697c82f09580ee877f816315a7110a, server=jenkins-hbase4.apache.org,40397,1695153672742 in 172 msec 2023-09-19 20:02:24,448 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=60, resume processing ppid=59 2023-09-19 20:02:24,448 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure 21d5efa9d832e0188c4afe38817df632, server=jenkins-hbase4.apache.org,40839,1695153672784 in 177 msec 2023-09-19 20:02:24,448 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c9697c82f09580ee877f816315a7110a, ASSIGN in 336 msec 2023-09-19 20:02:24,449 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=59, resume processing ppid=57 2023-09-19 20:02:24,450 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=21d5efa9d832e0188c4afe38817df632, ASSIGN in 337 msec 2023-09-19 20:02:24,450 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-19 20:02:24,450 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695153744450"}]},"ts":"1695153744450"} 2023-09-19 20:02:24,451 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-09-19 20:02:24,454 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-09-19 20:02:24,454 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-09-19 20:02:24,456 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40839] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-19 20:02:24,457 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 20:02:24,457 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 20:02:24,457 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 20:02:24,457 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 20:02:24,459 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-19 20:02:24,460 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-19 20:02:24,460 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-19 20:02:24,460 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-19 20:02:24,461 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 396 msec 2023-09-19 20:02:24,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-19 20:02:24,670 INFO [Listener at jenkins-hbase4.apache.org/45213] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-09-19 20:02:24,672 DEBUG [Listener at jenkins-hbase4.apache.org/45213] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,673 DEBUG [Listener at jenkins-hbase4.apache.org/45213] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1695153744062.c9697c82f09580ee877f816315a7110a. 2023-09-19 20:02:24,674 INFO [Listener at jenkins-hbase4.apache.org/45213] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-19 20:02:24,685 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-19 20:02:24,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695153744686 (current time:1695153744686). 2023-09-19 20:02:24,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-19 20:02:24,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] zookeeper.ReadOnlyZKClient(139): Connect 0x7cf77ff5 to 127.0.0.1:60323 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-19 20:02:24,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@63081a72, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-19 20:02:24,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 20:02:24,698 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42868, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 20:02:24,698 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7cf77ff5 to 127.0.0.1:60323 2023-09-19 20:02:24,698 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 20:02:24,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] zookeeper.ReadOnlyZKClient(139): Connect 0x31a67ecd to 127.0.0.1:60323 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-19 20:02:24,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@76e9a7db, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-19 20:02:24,705 DEBUG [hconnection-0x5591f8fe-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 20:02:24,706 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42874, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 20:02:24,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 20:02:24,713 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39082, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 20:02:24,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x31a67ecd to 127.0.0.1:60323 2023-09-19 20:02:24,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 20:02:24,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-19 20:02:24,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-19 20:02:24,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-19 20:02:24,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] procedure2.ProcedureExecutor(1028): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-19 20:02:24,718 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-19 20:02:24,718 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1695154344718 2023-09-19 20:02:24,718 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-19 20:02:24,719 DEBUG [Listener at jenkins-hbase4.apache.org/45213] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-19 20:02:24,720 DEBUG [Listener at jenkins-hbase4.apache.org/45213] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-19 20:02:24,720 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-19 20:02:24,721 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-19 20:02:24,722 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-09-19 20:02:24,722 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-19 20:02:24,723 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1695154344723 2023-09-19 20:02:24,734 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,734 INFO [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-09-19 20:02:24,734 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 20:02:24,735 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-09-19 20:02:24,735 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-09-19 20:02:24,736 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,736 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,738 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 20:02:24,738 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 20:02:24,738 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 20:02:24,738 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 20:02:24,738 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:24,738 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 20:02:24,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 20:02:24,738 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 20:02:24,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 20:02:24,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 20:02:24,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,738 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:24,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,739 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,738 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:24,739 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,739 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-19 20:02:24,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,739 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:24,739 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-19 20:02:24,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-19 20:02:24,739 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-19 20:02:24,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-19 20:02:24,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,739 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-19 20:02:24,740 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-19 20:02:24,739 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,740 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-19 20:02:24,740 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,740 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 20:02:24,740 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-19 20:02:24,740 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,741 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 20:02:24,741 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-19 20:02:24,742 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-19 20:02:24,742 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-19 20:02:24,742 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-19 20:02:24,742 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40397,1695153672742' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-19 20:02:24,741 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-19 20:02:24,742 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45123,1695153672695' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-19 20:02:24,742 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 20:02:24,743 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-19 20:02:24,743 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-19 20:02:24,743 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40839,1695153672784' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-19 20:02:24,744 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,744 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:24,744 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:24,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 20:02:24,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 20:02:24,745 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:24,745 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,745 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 20:02:24,745 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 20:02:24,745 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,745 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 20:02:24,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 20:02:24,745 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,745 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 20:02:24,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:24,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:24,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:24,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 20:02:24,747 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40397,1695153672742' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-19 20:02:24,747 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2f95cccb[Count = 1] remaining members to acquire global barrier 2023-09-19 20:02:24,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:24,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 20:02:24,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 20:02:24,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 20:02:24,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 20:02:24,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:24,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:24,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:24,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 20:02:24,749 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40839,1695153672784' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-19 20:02:24,749 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2f95cccb[Count = 0] remaining members to acquire global barrier 2023-09-19 20:02:24,749 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-09-19 20:02:24,749 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,750 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,750 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,750 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,750 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,750 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:24,750 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,750 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-19 20:02:24,750 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,750 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:24,750 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-19 20:02:24,750 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-19 20:02:24,751 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-19 20:02:24,750 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-19 20:02:24,751 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-19 20:02:24,751 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-19 20:02:24,751 DEBUG [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695153744062.c9697c82f09580ee877f816315a7110a. 2023-09-19 20:02:24,751 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-19 20:02:24,751 DEBUG [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695153744062.c9697c82f09580ee877f816315a7110a. started... 2023-09-19 20:02:24,750 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-19 20:02:24,750 DEBUG [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695153744062.21d5efa9d832e0188c4afe38817df632. 2023-09-19 20:02:24,751 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,45123,1695153672695' in zk 2023-09-19 20:02:24,751 DEBUG [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695153744062.21d5efa9d832e0188c4afe38817df632. started... 2023-09-19 20:02:24,751 DEBUG [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c9697c82f09580ee877f816315a7110a: 2023-09-19 20:02:24,752 DEBUG [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 21d5efa9d832e0188c4afe38817df632: 2023-09-19 20:02:24,752 DEBUG [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1695153744062.c9697c82f09580ee877f816315a7110a.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,752 DEBUG [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-19 20:02:24,752 DEBUG [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1695153744062.21d5efa9d832e0188c4afe38817df632.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,752 DEBUG [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-19 20:02:24,752 DEBUG [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-19 20:02:24,752 DEBUG [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-19 20:02:24,759 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-19 20:02:24,759 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 20:02:24,759 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-19 20:02:24,762 DEBUG [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695153744062.21d5efa9d832e0188c4afe38817df632. completed. 2023-09-19 20:02:24,762 DEBUG [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695153744062.c9697c82f09580ee877f816315a7110a. completed. 2023-09-19 20:02:24,762 DEBUG [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695153744062.21d5efa9d832e0188c4afe38817df632. 2023-09-19 20:02:24,762 DEBUG [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695153744062.c9697c82f09580ee877f816315a7110a. 2023-09-19 20:02:24,762 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-19 20:02:24,762 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-19 20:02:24,762 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-19 20:02:24,763 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-19 20:02:24,762 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:24,763 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:24,763 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-19 20:02:24,763 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-19 20:02:24,763 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,40839,1695153672784' in zk 2023-09-19 20:02:24,763 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,40397,1695153672742' in zk 2023-09-19 20:02:24,764 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-19 20:02:24,764 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-19 20:02:24,764 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:24,764 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 20:02:24,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:24,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 20:02:24,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 20:02:24,764 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 20:02:24,764 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-19 20:02:24,764 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:24,766 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-19 20:02:24,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 20:02:24,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 20:02:24,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:24,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:24,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:24,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 20:02:24,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:24,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:24,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:24,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,40839,1695153672784': 2023-09-19 20:02:24,770 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40839,1695153672784' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-09-19 20:02:24,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:24,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 20:02:24,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 20:02:24,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 20:02:24,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 20:02:24,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:24,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:24,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:24,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 20:02:24,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:24,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:24,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:24,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,40397,1695153672742': 2023-09-19 20:02:24,773 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40397,1695153672742' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-09-19 20:02:24,773 INFO [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-09-19 20:02:24,773 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-19 20:02:24,773 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-19 20:02:24,773 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,773 INFO [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-19 20:02:24,775 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,775 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,775 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,775 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,775 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 20:02:24,775 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 20:02:24,775 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,775 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,775 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 20:02:24,775 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 20:02:24,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 20:02:24,775 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:24,776 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 20:02:24,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 20:02:24,775 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 20:02:24,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 20:02:24,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,776 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:24,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,777 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:24,779 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:24,779 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,779 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:24,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 20:02:24,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 20:02:24,779 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:24,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 20:02:24,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 20:02:24,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:24,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:24,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:24,783 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:24,783 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,783 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:24,783 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 20:02:24,783 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 20:02:24,783 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 20:02:24,783 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 20:02:24,783 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 20:02:24,783 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 20:02:24,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 20:02:24,783 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 20:02:24,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 20:02:24,783 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 20:02:24,783 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:24,785 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 20:02:24,783 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 20:02:24,783 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 20:02:24,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 20:02:24,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 20:02:24,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 20:02:24,785 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion because node does not exist (not an error) 2023-09-19 20:02:24,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 20:02:24,785 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,785 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 20:02:24,786 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 20:02:24,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 20:02:24,786 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:24,786 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,786 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,786 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-19 20:02:24,786 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:24,786 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:24,786 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,786 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,787 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-19 20:02:24,799 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,800 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,819 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,819 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-09-19 20:02:24,820 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,820 DEBUG [Listener at jenkins-hbase4.apache.org/45213] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-19 20:02:24,820 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,820 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1695153744718Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1695153744799 (+81 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695153744799Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695153744799Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695153744805 (+6 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695153744813 (+8 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1695153744819 (+6 ms) 2023-09-19 20:02:24,823 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-19 20:02:24,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-19 20:02:24,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-19 20:02:24,824 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 104 msec 2023-09-19 20:02:24,825 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40397] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1695153744062.c9697c82f09580ee877f816315a7110a. with WAL disabled. Data may be lost in the event of a crash. 2023-09-19 20:02:24,827 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40839] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1695153744062.21d5efa9d832e0188c4afe38817df632. with WAL disabled. Data may be lost in the event of a crash. 2023-09-19 20:02:24,830 DEBUG [Listener at jenkins-hbase4.apache.org/45213] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,830 DEBUG [Listener at jenkins-hbase4.apache.org/45213] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1695153744062.c9697c82f09580ee877f816315a7110a. 2023-09-19 20:02:24,830 INFO [Listener at jenkins-hbase4.apache.org/45213] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-19 20:02:24,840 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-19 20:02:24,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695153744840 (current time:1695153744840). 2023-09-19 20:02:24,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-19 20:02:24,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] zookeeper.ReadOnlyZKClient(139): Connect 0x1d579cc9 to 127.0.0.1:60323 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-19 20:02:24,849 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4ac2f1be, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-19 20:02:24,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 20:02:24,853 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42888, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 20:02:24,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1d579cc9 to 127.0.0.1:60323 2023-09-19 20:02:24,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 20:02:24,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] zookeeper.ReadOnlyZKClient(139): Connect 0x14c98b58 to 127.0.0.1:60323 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-19 20:02:24,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3559ecdc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-19 20:02:24,861 DEBUG [hconnection-0x684ba4c8-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 20:02:24,863 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42892, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 20:02:24,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 20:02:24,868 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39094, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 20:02:24,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x14c98b58 to 127.0.0.1:60323 2023-09-19 20:02:24,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 20:02:24,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-19 20:02:24,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-19 20:02:24,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-19 20:02:24,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] procedure2.ProcedureExecutor(1028): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-19 20:02:24,873 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-19 20:02:24,874 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1695154344874 2023-09-19 20:02:24,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-19 20:02:24,874 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,875 DEBUG [Listener at jenkins-hbase4.apache.org/45213] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-19 20:02:24,875 DEBUG [Listener at jenkins-hbase4.apache.org/45213] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-19 20:02:24,877 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-19 20:02:24,877 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-19 20:02:24,878 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 6 msec 2023-09-19 20:02:24,879 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-19 20:02:24,880 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1695154344880 2023-09-19 20:02:24,888 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,888 INFO [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-09-19 20:02:24,888 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 20:02:24,889 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-09-19 20:02:24,889 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-09-19 20:02:24,890 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,890 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,896 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 20:02:24,896 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:24,896 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 20:02:24,896 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 20:02:24,896 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 20:02:24,896 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 20:02:24,896 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 20:02:24,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 20:02:24,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 20:02:24,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 20:02:24,896 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:24,896 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:24,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,897 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:24,897 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-19 20:02:24,897 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,897 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,897 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-19 20:02:24,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-19 20:02:24,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-19 20:02:24,898 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-19 20:02:24,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,898 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-19 20:02:24,898 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,898 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-19 20:02:24,898 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-19 20:02:24,898 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 20:02:24,898 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,899 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-19 20:02:24,899 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,899 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-19 20:02:24,899 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-19 20:02:24,899 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 20:02:24,899 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-19 20:02:24,900 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-19 20:02:24,900 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-19 20:02:24,900 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40839,1695153672784' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-19 20:02:24,900 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45123,1695153672695' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-19 20:02:24,899 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 20:02:24,902 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-19 20:02:24,902 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-19 20:02:24,902 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40397,1695153672742' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-19 20:02:24,904 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:24,904 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:24,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 20:02:24,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 20:02:24,904 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,904 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:24,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 20:02:24,904 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,905 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 20:02:24,904 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,905 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,905 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 20:02:24,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 20:02:24,905 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,905 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 20:02:24,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:24,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:24,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:24,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 20:02:24,906 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40839,1695153672784' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-19 20:02:24,906 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@12096131[Count = 1] remaining members to acquire global barrier 2023-09-19 20:02:24,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:24,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 20:02:24,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 20:02:24,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 20:02:24,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 20:02:24,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:24,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:24,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:24,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 20:02:24,908 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40397,1695153672742' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-19 20:02:24,908 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@12096131[Count = 0] remaining members to acquire global barrier 2023-09-19 20:02:24,908 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-09-19 20:02:24,908 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,909 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,909 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,909 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,909 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,910 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:24,909 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,910 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-19 20:02:24,910 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,910 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-19 20:02:24,910 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-19 20:02:24,910 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-19 20:02:24,910 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:24,910 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-19 20:02:24,910 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-19 20:02:24,910 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-19 20:02:24,910 DEBUG [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695153744062.c9697c82f09580ee877f816315a7110a. 2023-09-19 20:02:24,910 DEBUG [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695153744062.21d5efa9d832e0188c4afe38817df632. 2023-09-19 20:02:24,910 DEBUG [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695153744062.c9697c82f09580ee877f816315a7110a. started... 2023-09-19 20:02:24,910 DEBUG [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695153744062.21d5efa9d832e0188c4afe38817df632. started... 2023-09-19 20:02:24,910 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,45123,1695153672695' in zk 2023-09-19 20:02:24,910 INFO [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 21d5efa9d832e0188c4afe38817df632 1/1 column families, dataSize=3.19 KB heapSize=7.14 KB 2023-09-19 20:02:24,910 INFO [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] regionserver.HRegion(2745): Flushing c9697c82f09580ee877f816315a7110a 1/1 column families, dataSize=65 B heapSize=400 B 2023-09-19 20:02:24,910 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-19 20:02:24,911 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-19 20:02:24,914 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-19 20:02:24,914 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 20:02:24,914 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-19 20:02:24,929 INFO [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230919558fafe914644af19c945408ca5887e5 to hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230919558fafe914644af19c945408ca5887e5 2023-09-19 20:02:24,930 INFO [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202309190ed059c7c0ae43bbbc3582c4b32e1d63 to hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202309190ed059c7c0ae43bbbc3582c4b32e1d63 2023-09-19 20:02:24,938 INFO [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=65, hasBloomFilter=true, into tmp file hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemStateWithMergeRegion/c9697c82f09580ee877f816315a7110a/.tmp/cf/8d6a0c336cf3425eb04fbbe51a824621 2023-09-19 20:02:24,939 INFO [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.2 K, hasBloomFilter=true, into tmp file hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemStateWithMergeRegion/21d5efa9d832e0188c4afe38817df632/.tmp/cf/38b47a1a8c7d43b783abe82c0602eff8 2023-09-19 20:02:24,943 DEBUG [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemStateWithMergeRegion/c9697c82f09580ee877f816315a7110a/.tmp/cf/8d6a0c336cf3425eb04fbbe51a824621 as hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemStateWithMergeRegion/c9697c82f09580ee877f816315a7110a/cf/8d6a0c336cf3425eb04fbbe51a824621 2023-09-19 20:02:24,944 DEBUG [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemStateWithMergeRegion/21d5efa9d832e0188c4afe38817df632/.tmp/cf/38b47a1a8c7d43b783abe82c0602eff8 as hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemStateWithMergeRegion/21d5efa9d832e0188c4afe38817df632/cf/38b47a1a8c7d43b783abe82c0602eff8 2023-09-19 20:02:24,948 INFO [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemStateWithMergeRegion/c9697c82f09580ee877f816315a7110a/cf/8d6a0c336cf3425eb04fbbe51a824621, entries=1, sequenceid=6, filesize=5.1 K 2023-09-19 20:02:24,949 INFO [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemStateWithMergeRegion/21d5efa9d832e0188c4afe38817df632/cf/38b47a1a8c7d43b783abe82c0602eff8, entries=49, sequenceid=6, filesize=13.9 K 2023-09-19 20:02:24,949 INFO [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~65 B/65, heapSize ~384 B/384, currentSize=0 B/0 for c9697c82f09580ee877f816315a7110a in 39ms, sequenceid=6, compaction requested=false 2023-09-19 20:02:24,949 DEBUG [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-09-19 20:02:24,950 INFO [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.19 KB/3271, heapSize ~7.13 KB/7296, currentSize=0 B/0 for 21d5efa9d832e0188c4afe38817df632 in 40ms, sequenceid=6, compaction requested=false 2023-09-19 20:02:24,950 DEBUG [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-09-19 20:02:24,953 DEBUG [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 21d5efa9d832e0188c4afe38817df632: 2023-09-19 20:02:24,953 DEBUG [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c9697c82f09580ee877f816315a7110a: 2023-09-19 20:02:24,953 DEBUG [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1695153744062.21d5efa9d832e0188c4afe38817df632.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,953 DEBUG [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-19 20:02:24,953 DEBUG [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemStateWithMergeRegion/21d5efa9d832e0188c4afe38817df632/cf/38b47a1a8c7d43b783abe82c0602eff8] hfiles 2023-09-19 20:02:24,953 DEBUG [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemStateWithMergeRegion/21d5efa9d832e0188c4afe38817df632/cf/38b47a1a8c7d43b783abe82c0602eff8 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,953 DEBUG [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1695153744062.c9697c82f09580ee877f816315a7110a.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,953 DEBUG [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-19 20:02:24,953 DEBUG [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemStateWithMergeRegion/c9697c82f09580ee877f816315a7110a/cf/8d6a0c336cf3425eb04fbbe51a824621] hfiles 2023-09-19 20:02:24,953 DEBUG [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemStateWithMergeRegion/c9697c82f09580ee877f816315a7110a/cf/8d6a0c336cf3425eb04fbbe51a824621 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,962 DEBUG [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695153744062.21d5efa9d832e0188c4afe38817df632. completed. 2023-09-19 20:02:24,962 DEBUG [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695153744062.21d5efa9d832e0188c4afe38817df632. 2023-09-19 20:02:24,962 DEBUG [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695153744062.c9697c82f09580ee877f816315a7110a. completed. 2023-09-19 20:02:24,962 DEBUG [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695153744062.c9697c82f09580ee877f816315a7110a. 2023-09-19 20:02:24,962 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-19 20:02:24,963 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-19 20:02:24,962 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-19 20:02:24,963 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-19 20:02:24,963 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:24,963 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:24,963 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-19 20:02:24,963 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-19 20:02:24,963 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,40839,1695153672784' in zk 2023-09-19 20:02:24,963 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,40397,1695153672742' in zk 2023-09-19 20:02:24,964 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:24,964 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-19 20:02:24,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:24,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 20:02:24,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 20:02:24,964 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 20:02:24,965 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-19 20:02:24,966 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:24,966 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-19 20:02:24,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 20:02:24,966 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 20:02:24,967 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-19 20:02:24,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 20:02:24,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:24,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:24,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:24,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 20:02:24,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:24,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:24,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:24,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,40397,1695153672742': 2023-09-19 20:02:24,971 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40397,1695153672742' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-09-19 20:02:24,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:24,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 20:02:24,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 20:02:24,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 20:02:24,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 20:02:24,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:24,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:24,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:24,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 20:02:24,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:24,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:24,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:24,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,40839,1695153672784': 2023-09-19 20:02:24,974 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40839,1695153672784' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-09-19 20:02:24,974 INFO [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-09-19 20:02:24,974 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-19 20:02:24,974 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-19 20:02:24,974 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,974 INFO [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-19 20:02:24,975 DEBUG [Listener at jenkins-hbase4.apache.org/45213] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-19 20:02:24,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-19 20:02:24,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-09-19 20:02:24,977 DEBUG [Listener at jenkins-hbase4.apache.org/45213] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-19 20:02:24,979 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,979 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,979 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,979 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 20:02:24,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 20:02:24,979 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 20:02:24,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 20:02:24,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 20:02:24,979 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 20:02:24,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,979 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 20:02:24,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,979 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:24,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 20:02:24,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,980 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 20:02:24,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 20:02:24,980 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 20:02:24,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 20:02:24,980 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:24,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 20:02:24,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,980 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:24,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:24,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:24,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:24,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 20:02:24,982 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:24,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,982 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:24,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:24,983 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:24,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:24,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:24,985 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:24,985 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 20:02:24,985 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 20:02:24,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 20:02:24,985 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 20:02:24,985 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:24,986 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 20:02:24,985 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 20:02:24,985 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 20:02:24,987 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 20:02:24,987 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 20:02:24,987 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 20:02:24,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 20:02:24,987 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 20:02:24,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 20:02:24,987 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:24,985 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,987 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,988 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,988 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:24,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 20:02:24,987 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 20:02:24,988 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,988 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 20:02:24,988 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 20:02:24,988 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:24,988 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 20:02:24,988 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-19 20:02:24,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 20:02:24,988 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:24,988 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,988 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,989 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202309190ed059c7c0ae43bbbc3582c4b32e1d63, hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230919558fafe914644af19c945408ca5887e5] mob files 2023-09-19 20:02:24,989 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202309190ed059c7c0ae43bbbc3582c4b32e1d63 2023-09-19 20:02:24,989 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230919558fafe914644af19c945408ca5887e5 2023-09-19 20:02:24,996 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:24,997 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:25,014 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:25,015 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-09-19 20:02:25,015 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:25,015 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:25,015 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1695153744874Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1695153744996 (+122 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1695153744996Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1695153744996Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1695153744999 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1695153745008 (+9 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1695153745015 (+7 ms) 2023-09-19 20:02:25,018 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-19 20:02:25,019 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 143 msec 2023-09-19 20:02:25,177 DEBUG [Listener at jenkins-hbase4.apache.org/45213] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-19 20:02:25,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-19 20:02:25,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-19 20:02:25,206 DEBUG [Listener at jenkins-hbase4.apache.org/45213] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-19 20:02:25,212 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50250, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-19 20:02:25,213 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40397] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-19 20:02:25,214 DEBUG [Listener at jenkins-hbase4.apache.org/45213] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-19 20:02:25,218 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39102, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-19 20:02:25,218 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40839] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-19 20:02:25,219 DEBUG [Listener at jenkins-hbase4.apache.org/45213] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-19 20:02:25,221 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42906, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-19 20:02:25,221 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45123] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-19 20:02:25,223 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-09-19 20:02:25,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] procedure2.ProcedureExecutor(1028): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-19 20:02:25,225 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-09-19 20:02:25,226 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-09-19 20:02:25,226 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-19 20:02:25,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-19 20:02:25,229 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0dda698ecce877963cf3ea88bfefa522 2023-09-19 20:02:25,229 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/13ee165a76077b4b937f3d97272d565d 2023-09-19 20:02:25,229 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0dda698ecce877963cf3ea88bfefa522 empty. 2023-09-19 20:02:25,229 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/13ee165a76077b4b937f3d97272d565d empty. 2023-09-19 20:02:25,229 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0dda698ecce877963cf3ea88bfefa522 2023-09-19 20:02:25,230 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/13ee165a76077b4b937f3d97272d565d 2023-09-19 20:02:25,230 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-09-19 20:02:25,239 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-09-19 20:02:25,240 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 0dda698ecce877963cf3ea88bfefa522, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695153745223.0dda698ecce877963cf3ea88bfefa522.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp 2023-09-19 20:02:25,240 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 13ee165a76077b4b937f3d97272d565d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1695153745223.13ee165a76077b4b937f3d97272d565d.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp 2023-09-19 20:02:25,250 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1695153745223.0dda698ecce877963cf3ea88bfefa522.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 20:02:25,250 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 0dda698ecce877963cf3ea88bfefa522, disabling compactions & flushes 2023-09-19 20:02:25,250 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1695153745223.0dda698ecce877963cf3ea88bfefa522. 2023-09-19 20:02:25,250 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695153745223.0dda698ecce877963cf3ea88bfefa522. 2023-09-19 20:02:25,250 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1695153745223.13ee165a76077b4b937f3d97272d565d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 20:02:25,250 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695153745223.0dda698ecce877963cf3ea88bfefa522. after waiting 0 ms 2023-09-19 20:02:25,250 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 13ee165a76077b4b937f3d97272d565d, disabling compactions & flushes 2023-09-19 20:02:25,250 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1695153745223.0dda698ecce877963cf3ea88bfefa522. 2023-09-19 20:02:25,250 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695153745223.13ee165a76077b4b937f3d97272d565d. 2023-09-19 20:02:25,250 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1695153745223.0dda698ecce877963cf3ea88bfefa522. 2023-09-19 20:02:25,250 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695153745223.13ee165a76077b4b937f3d97272d565d. 2023-09-19 20:02:25,250 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695153745223.13ee165a76077b4b937f3d97272d565d. after waiting 0 ms 2023-09-19 20:02:25,250 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695153745223.13ee165a76077b4b937f3d97272d565d. 2023-09-19 20:02:25,250 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 0dda698ecce877963cf3ea88bfefa522: 2023-09-19 20:02:25,250 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1695153745223.13ee165a76077b4b937f3d97272d565d. 2023-09-19 20:02:25,250 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 13ee165a76077b4b937f3d97272d565d: 2023-09-19 20:02:25,252 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-09-19 20:02:25,253 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695153745223.0dda698ecce877963cf3ea88bfefa522.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695153745253"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695153745253"}]},"ts":"1695153745253"} 2023-09-19 20:02:25,253 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695153745223.13ee165a76077b4b937f3d97272d565d.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695153745253"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695153745253"}]},"ts":"1695153745253"} 2023-09-19 20:02:25,255 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-19 20:02:25,256 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-19 20:02:25,256 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695153745256"}]},"ts":"1695153745256"} 2023-09-19 20:02:25,257 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-09-19 20:02:25,260 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-19 20:02:25,261 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-19 20:02:25,261 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-19 20:02:25,261 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-19 20:02:25,261 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-19 20:02:25,261 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0dda698ecce877963cf3ea88bfefa522, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=13ee165a76077b4b937f3d97272d565d, ASSIGN}] 2023-09-19 20:02:25,264 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=13ee165a76077b4b937f3d97272d565d, ASSIGN 2023-09-19 20:02:25,264 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0dda698ecce877963cf3ea88bfefa522, ASSIGN 2023-09-19 20:02:25,265 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=13ee165a76077b4b937f3d97272d565d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45123,1695153672695; forceNewPlan=false, retain=false 2023-09-19 20:02:25,265 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0dda698ecce877963cf3ea88bfefa522, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40839,1695153672784; forceNewPlan=false, retain=false 2023-09-19 20:02:25,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-19 20:02:25,415 INFO [jenkins-hbase4:37929] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-19 20:02:25,418 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=13ee165a76077b4b937f3d97272d565d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:25,418 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=0dda698ecce877963cf3ea88bfefa522, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:25,418 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695153745223.13ee165a76077b4b937f3d97272d565d.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695153745417"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695153745417"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695153745417"}]},"ts":"1695153745417"} 2023-09-19 20:02:25,418 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695153745223.0dda698ecce877963cf3ea88bfefa522.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695153745417"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695153745417"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695153745417"}]},"ts":"1695153745417"} 2023-09-19 20:02:25,420 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 0dda698ecce877963cf3ea88bfefa522, server=jenkins-hbase4.apache.org,40839,1695153672784}] 2023-09-19 20:02:25,421 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=70, ppid=68, state=RUNNABLE; OpenRegionProcedure 13ee165a76077b4b937f3d97272d565d, server=jenkins-hbase4.apache.org,45123,1695153672695}] 2023-09-19 20:02:25,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-19 20:02:25,574 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1695153745223.0dda698ecce877963cf3ea88bfefa522. 2023-09-19 20:02:25,575 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0dda698ecce877963cf3ea88bfefa522, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695153745223.0dda698ecce877963cf3ea88bfefa522.', STARTKEY => '', ENDKEY => '2'} 2023-09-19 20:02:25,575 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1695153745223.0dda698ecce877963cf3ea88bfefa522. service=AccessControlService 2023-09-19 20:02:25,575 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-19 20:02:25,575 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 0dda698ecce877963cf3ea88bfefa522 2023-09-19 20:02:25,575 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1695153745223.0dda698ecce877963cf3ea88bfefa522.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 20:02:25,575 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0dda698ecce877963cf3ea88bfefa522 2023-09-19 20:02:25,575 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0dda698ecce877963cf3ea88bfefa522 2023-09-19 20:02:25,579 INFO [StoreOpener-0dda698ecce877963cf3ea88bfefa522-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0dda698ecce877963cf3ea88bfefa522 2023-09-19 20:02:25,583 DEBUG [StoreOpener-0dda698ecce877963cf3ea88bfefa522-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0dda698ecce877963cf3ea88bfefa522/cf 2023-09-19 20:02:25,583 DEBUG [StoreOpener-0dda698ecce877963cf3ea88bfefa522-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0dda698ecce877963cf3ea88bfefa522/cf 2023-09-19 20:02:25,584 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1695153745223.13ee165a76077b4b937f3d97272d565d. 2023-09-19 20:02:25,584 INFO [StoreOpener-0dda698ecce877963cf3ea88bfefa522-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0dda698ecce877963cf3ea88bfefa522 columnFamilyName cf 2023-09-19 20:02:25,584 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 13ee165a76077b4b937f3d97272d565d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1695153745223.13ee165a76077b4b937f3d97272d565d.', STARTKEY => '2', ENDKEY => ''} 2023-09-19 20:02:25,584 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1695153745223.13ee165a76077b4b937f3d97272d565d. service=AccessControlService 2023-09-19 20:02:25,584 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-19 20:02:25,584 INFO [StoreOpener-0dda698ecce877963cf3ea88bfefa522-1] regionserver.HStore(310): Store=0dda698ecce877963cf3ea88bfefa522/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-19 20:02:25,584 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 13ee165a76077b4b937f3d97272d565d 2023-09-19 20:02:25,585 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1695153745223.13ee165a76077b4b937f3d97272d565d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 20:02:25,585 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 13ee165a76077b4b937f3d97272d565d 2023-09-19 20:02:25,585 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 13ee165a76077b4b937f3d97272d565d 2023-09-19 20:02:25,585 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0dda698ecce877963cf3ea88bfefa522 2023-09-19 20:02:25,586 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0dda698ecce877963cf3ea88bfefa522 2023-09-19 20:02:25,586 INFO [StoreOpener-13ee165a76077b4b937f3d97272d565d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 13ee165a76077b4b937f3d97272d565d 2023-09-19 20:02:25,587 DEBUG [StoreOpener-13ee165a76077b4b937f3d97272d565d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/13ee165a76077b4b937f3d97272d565d/cf 2023-09-19 20:02:25,587 DEBUG [StoreOpener-13ee165a76077b4b937f3d97272d565d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/13ee165a76077b4b937f3d97272d565d/cf 2023-09-19 20:02:25,587 INFO [StoreOpener-13ee165a76077b4b937f3d97272d565d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 13ee165a76077b4b937f3d97272d565d columnFamilyName cf 2023-09-19 20:02:25,588 INFO [StoreOpener-13ee165a76077b4b937f3d97272d565d-1] regionserver.HStore(310): Store=13ee165a76077b4b937f3d97272d565d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-19 20:02:25,589 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0dda698ecce877963cf3ea88bfefa522 2023-09-19 20:02:25,589 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/13ee165a76077b4b937f3d97272d565d 2023-09-19 20:02:25,589 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/13ee165a76077b4b937f3d97272d565d 2023-09-19 20:02:25,591 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0dda698ecce877963cf3ea88bfefa522/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-19 20:02:25,591 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0dda698ecce877963cf3ea88bfefa522; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69349049, jitterRate=0.03338135778903961}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-19 20:02:25,591 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0dda698ecce877963cf3ea88bfefa522: 2023-09-19 20:02:25,592 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1695153745223.0dda698ecce877963cf3ea88bfefa522., pid=69, masterSystemTime=1695153745572 2023-09-19 20:02:25,592 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 13ee165a76077b4b937f3d97272d565d 2023-09-19 20:02:25,593 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1695153745223.0dda698ecce877963cf3ea88bfefa522. 2023-09-19 20:02:25,593 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1695153745223.0dda698ecce877963cf3ea88bfefa522. 2023-09-19 20:02:25,594 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/13ee165a76077b4b937f3d97272d565d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-19 20:02:25,594 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=0dda698ecce877963cf3ea88bfefa522, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:25,594 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695153745223.0dda698ecce877963cf3ea88bfefa522.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695153745594"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695153745594"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695153745594"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695153745594"}]},"ts":"1695153745594"} 2023-09-19 20:02:25,594 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 13ee165a76077b4b937f3d97272d565d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63057330, jitterRate=-0.06037256121635437}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-19 20:02:25,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 13ee165a76077b4b937f3d97272d565d: 2023-09-19 20:02:25,595 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1695153745223.13ee165a76077b4b937f3d97272d565d., pid=70, masterSystemTime=1695153745576 2023-09-19 20:02:25,597 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1695153745223.13ee165a76077b4b937f3d97272d565d. 2023-09-19 20:02:25,597 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1695153745223.13ee165a76077b4b937f3d97272d565d. 2023-09-19 20:02:25,598 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=13ee165a76077b4b937f3d97272d565d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:25,598 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695153745223.13ee165a76077b4b937f3d97272d565d.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695153745597"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695153745597"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695153745597"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695153745597"}]},"ts":"1695153745597"} 2023-09-19 20:02:25,598 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=69, resume processing ppid=67 2023-09-19 20:02:25,598 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 0dda698ecce877963cf3ea88bfefa522, server=jenkins-hbase4.apache.org,40839,1695153672784 in 176 msec 2023-09-19 20:02:25,600 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0dda698ecce877963cf3ea88bfefa522, ASSIGN in 337 msec 2023-09-19 20:02:25,601 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=70, resume processing ppid=68 2023-09-19 20:02:25,601 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=70, ppid=68, state=SUCCESS; OpenRegionProcedure 13ee165a76077b4b937f3d97272d565d, server=jenkins-hbase4.apache.org,45123,1695153672695 in 178 msec 2023-09-19 20:02:25,602 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=68, resume processing ppid=66 2023-09-19 20:02:25,602 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=13ee165a76077b4b937f3d97272d565d, ASSIGN in 340 msec 2023-09-19 20:02:25,603 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-19 20:02:25,603 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695153745603"}]},"ts":"1695153745603"} 2023-09-19 20:02:25,604 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-09-19 20:02:25,607 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-09-19 20:02:25,608 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-09-19 20:02:25,609 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40839] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-09-19 20:02:25,611 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 20:02:25,611 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 20:02:25,611 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 20:02:25,611 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 20:02:25,612 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-19 20:02:25,612 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-19 20:02:25,612 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-19 20:02:25,612 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-19 20:02:25,613 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-19 20:02:25,613 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-19 20:02:25,613 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-19 20:02:25,613 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-19 20:02:25,613 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 389 msec 2023-09-19 20:02:25,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-19 20:02:25,831 INFO [Listener at jenkins-hbase4.apache.org/45213] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-09-19 20:02:25,851 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions 0dda698ecce877963cf3ea88bfefa522, 13ee165a76077b4b937f3d97272d565d 2023-09-19 20:02:25,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] procedure2.ProcedureExecutor(1028): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[0dda698ecce877963cf3ea88bfefa522, 13ee165a76077b4b937f3d97272d565d], force=true 2023-09-19 20:02:25,862 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[0dda698ecce877963cf3ea88bfefa522, 13ee165a76077b4b937f3d97272d565d], force=true 2023-09-19 20:02:25,862 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[0dda698ecce877963cf3ea88bfefa522, 13ee165a76077b4b937f3d97272d565d], force=true 2023-09-19 20:02:25,862 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[0dda698ecce877963cf3ea88bfefa522, 13ee165a76077b4b937f3d97272d565d], force=true 2023-09-19 20:02:25,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-19 20:02:25,883 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0dda698ecce877963cf3ea88bfefa522, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=13ee165a76077b4b937f3d97272d565d, UNASSIGN}] 2023-09-19 20:02:25,885 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0dda698ecce877963cf3ea88bfefa522, UNASSIGN 2023-09-19 20:02:25,885 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=13ee165a76077b4b937f3d97272d565d, UNASSIGN 2023-09-19 20:02:25,887 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=0dda698ecce877963cf3ea88bfefa522, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:25,887 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=13ee165a76077b4b937f3d97272d565d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:25,887 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695153745223.0dda698ecce877963cf3ea88bfefa522.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695153745887"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695153745887"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695153745887"}]},"ts":"1695153745887"} 2023-09-19 20:02:25,887 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695153745223.13ee165a76077b4b937f3d97272d565d.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695153745887"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695153745887"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695153745887"}]},"ts":"1695153745887"} 2023-09-19 20:02:25,889 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=74, ppid=73, state=RUNNABLE; CloseRegionProcedure 13ee165a76077b4b937f3d97272d565d, server=jenkins-hbase4.apache.org,45123,1695153672695}] 2023-09-19 20:02:25,890 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=75, ppid=72, state=RUNNABLE; CloseRegionProcedure 0dda698ecce877963cf3ea88bfefa522, server=jenkins-hbase4.apache.org,40839,1695153672784}] 2023-09-19 20:02:25,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-19 20:02:26,041 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 13ee165a76077b4b937f3d97272d565d 2023-09-19 20:02:26,043 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 13ee165a76077b4b937f3d97272d565d, disabling compactions & flushes 2023-09-19 20:02:26,043 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695153745223.13ee165a76077b4b937f3d97272d565d. 2023-09-19 20:02:26,043 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695153745223.13ee165a76077b4b937f3d97272d565d. 2023-09-19 20:02:26,043 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695153745223.13ee165a76077b4b937f3d97272d565d. after waiting 0 ms 2023-09-19 20:02:26,043 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695153745223.13ee165a76077b4b937f3d97272d565d. 2023-09-19 20:02:26,043 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 13ee165a76077b4b937f3d97272d565d 1/1 column families, dataSize=24 B heapSize=352 B 2023-09-19 20:02:26,043 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 0dda698ecce877963cf3ea88bfefa522 2023-09-19 20:02:26,045 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0dda698ecce877963cf3ea88bfefa522, disabling compactions & flushes 2023-09-19 20:02:26,045 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1695153745223.0dda698ecce877963cf3ea88bfefa522. 2023-09-19 20:02:26,045 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695153745223.0dda698ecce877963cf3ea88bfefa522. 2023-09-19 20:02:26,045 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695153745223.0dda698ecce877963cf3ea88bfefa522. after waiting 0 ms 2023-09-19 20:02:26,045 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1695153745223.0dda698ecce877963cf3ea88bfefa522. 2023-09-19 20:02:26,045 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 0dda698ecce877963cf3ea88bfefa522 1/1 column families, dataSize=24 B heapSize=352 B 2023-09-19 20:02:26,055 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0dda698ecce877963cf3ea88bfefa522/.tmp/cf/bac2504a7beb438497a5f48c1333fe00 2023-09-19 20:02:26,055 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/13ee165a76077b4b937f3d97272d565d/.tmp/cf/76a4da8fd25f4af9aa042e6227dc010b 2023-09-19 20:02:26,063 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0dda698ecce877963cf3ea88bfefa522/.tmp/cf/bac2504a7beb438497a5f48c1333fe00 as hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0dda698ecce877963cf3ea88bfefa522/cf/bac2504a7beb438497a5f48c1333fe00 2023-09-19 20:02:26,064 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/13ee165a76077b4b937f3d97272d565d/.tmp/cf/76a4da8fd25f4af9aa042e6227dc010b as hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/13ee165a76077b4b937f3d97272d565d/cf/76a4da8fd25f4af9aa042e6227dc010b 2023-09-19 20:02:26,070 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0dda698ecce877963cf3ea88bfefa522/cf/bac2504a7beb438497a5f48c1333fe00, entries=1, sequenceid=5, filesize=4.7 K 2023-09-19 20:02:26,070 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 0dda698ecce877963cf3ea88bfefa522 in 25ms, sequenceid=5, compaction requested=false 2023-09-19 20:02:26,071 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-09-19 20:02:26,071 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/13ee165a76077b4b937f3d97272d565d/cf/76a4da8fd25f4af9aa042e6227dc010b, entries=1, sequenceid=5, filesize=4.7 K 2023-09-19 20:02:26,071 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 13ee165a76077b4b937f3d97272d565d in 28ms, sequenceid=5, compaction requested=false 2023-09-19 20:02:26,081 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0dda698ecce877963cf3ea88bfefa522/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-09-19 20:02:26,082 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/13ee165a76077b4b937f3d97272d565d/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-09-19 20:02:26,082 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-19 20:02:26,082 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1695153745223.0dda698ecce877963cf3ea88bfefa522. 2023-09-19 20:02:26,082 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0dda698ecce877963cf3ea88bfefa522: 2023-09-19 20:02:26,082 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-19 20:02:26,082 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1695153745223.13ee165a76077b4b937f3d97272d565d. 2023-09-19 20:02:26,082 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 13ee165a76077b4b937f3d97272d565d: 2023-09-19 20:02:26,083 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 0dda698ecce877963cf3ea88bfefa522 2023-09-19 20:02:26,084 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=0dda698ecce877963cf3ea88bfefa522, regionState=CLOSED 2023-09-19 20:02:26,084 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 13ee165a76077b4b937f3d97272d565d 2023-09-19 20:02:26,084 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695153745223.0dda698ecce877963cf3ea88bfefa522.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695153746084"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695153746084"}]},"ts":"1695153746084"} 2023-09-19 20:02:26,084 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=13ee165a76077b4b937f3d97272d565d, regionState=CLOSED 2023-09-19 20:02:26,084 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695153745223.13ee165a76077b4b937f3d97272d565d.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695153746084"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695153746084"}]},"ts":"1695153746084"} 2023-09-19 20:02:26,087 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=75, resume processing ppid=72 2023-09-19 20:02:26,087 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=75, ppid=72, state=SUCCESS; CloseRegionProcedure 0dda698ecce877963cf3ea88bfefa522, server=jenkins-hbase4.apache.org,40839,1695153672784 in 195 msec 2023-09-19 20:02:26,087 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=74, resume processing ppid=73 2023-09-19 20:02:26,087 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=74, ppid=73, state=SUCCESS; CloseRegionProcedure 13ee165a76077b4b937f3d97272d565d, server=jenkins-hbase4.apache.org,45123,1695153672695 in 198 msec 2023-09-19 20:02:26,088 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0dda698ecce877963cf3ea88bfefa522, UNASSIGN in 207 msec 2023-09-19 20:02:26,089 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=73, resume processing ppid=71 2023-09-19 20:02:26,089 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=13ee165a76077b4b937f3d97272d565d, UNASSIGN in 204 msec 2023-09-19 20:02:26,127 DEBUG [PEWorker-5] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2829be20116aa7e267be9144f381c0c1/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-09-19 20:02:26,129 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695153745223.0dda698ecce877963cf3ea88bfefa522.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-19 20:02:26,129 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695153745223.13ee165a76077b4b937f3d97272d565d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-19 20:02:26,129 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695153745224.2829be20116aa7e267be9144f381c0c1.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-19 20:02:26,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-19 20:02:26,178 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2829be20116aa7e267be9144f381c0c1, ASSIGN}] 2023-09-19 20:02:26,181 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2829be20116aa7e267be9144f381c0c1, ASSIGN 2023-09-19 20:02:26,182 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2829be20116aa7e267be9144f381c0c1, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,40839,1695153672784; forceNewPlan=false, retain=false 2023-09-19 20:02:26,332 INFO [jenkins-hbase4:37929] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-19 20:02:26,334 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=2829be20116aa7e267be9144f381c0c1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:26,334 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695153745224.2829be20116aa7e267be9144f381c0c1.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695153746334"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695153746334"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695153746334"}]},"ts":"1695153746334"} 2023-09-19 20:02:26,336 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 2829be20116aa7e267be9144f381c0c1, server=jenkins-hbase4.apache.org,40839,1695153672784}] 2023-09-19 20:02:26,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-19 20:02:26,491 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1695153745224.2829be20116aa7e267be9144f381c0c1. 2023-09-19 20:02:26,491 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2829be20116aa7e267be9144f381c0c1, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695153745224.2829be20116aa7e267be9144f381c0c1.', STARTKEY => '', ENDKEY => ''} 2023-09-19 20:02:26,491 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1695153745224.2829be20116aa7e267be9144f381c0c1. service=AccessControlService 2023-09-19 20:02:26,491 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-19 20:02:26,491 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 2829be20116aa7e267be9144f381c0c1 2023-09-19 20:02:26,491 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1695153745224.2829be20116aa7e267be9144f381c0c1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 20:02:26,492 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2829be20116aa7e267be9144f381c0c1 2023-09-19 20:02:26,492 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2829be20116aa7e267be9144f381c0c1 2023-09-19 20:02:26,492 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2829be20116aa7e267be9144f381c0c1/.regioninfo 2023-09-19 20:02:26,503 INFO [StoreOpener-2829be20116aa7e267be9144f381c0c1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 2829be20116aa7e267be9144f381c0c1 2023-09-19 20:02:26,504 DEBUG [StoreOpener-2829be20116aa7e267be9144f381c0c1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2829be20116aa7e267be9144f381c0c1/cf 2023-09-19 20:02:26,504 DEBUG [StoreOpener-2829be20116aa7e267be9144f381c0c1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2829be20116aa7e267be9144f381c0c1/cf 2023-09-19 20:02:26,504 INFO [StoreOpener-2829be20116aa7e267be9144f381c0c1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2829be20116aa7e267be9144f381c0c1 columnFamilyName cf 2023-09-19 20:02:26,533 DEBUG [StoreOpener-2829be20116aa7e267be9144f381c0c1-1] regionserver.HStore(539): loaded hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2829be20116aa7e267be9144f381c0c1/cf/76a4da8fd25f4af9aa042e6227dc010b.13ee165a76077b4b937f3d97272d565d->hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/13ee165a76077b4b937f3d97272d565d/cf/76a4da8fd25f4af9aa042e6227dc010b-top 2023-09-19 20:02:26,538 DEBUG [StoreOpener-2829be20116aa7e267be9144f381c0c1-1] regionserver.HStore(539): loaded hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2829be20116aa7e267be9144f381c0c1/cf/bac2504a7beb438497a5f48c1333fe00.0dda698ecce877963cf3ea88bfefa522->hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0dda698ecce877963cf3ea88bfefa522/cf/bac2504a7beb438497a5f48c1333fe00-top 2023-09-19 20:02:26,539 INFO [StoreOpener-2829be20116aa7e267be9144f381c0c1-1] regionserver.HStore(310): Store=2829be20116aa7e267be9144f381c0c1/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-19 20:02:26,539 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2829be20116aa7e267be9144f381c0c1 2023-09-19 20:02:26,540 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2829be20116aa7e267be9144f381c0c1 2023-09-19 20:02:26,543 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2829be20116aa7e267be9144f381c0c1 2023-09-19 20:02:26,544 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2829be20116aa7e267be9144f381c0c1; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65863065, jitterRate=-0.018563851714134216}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-19 20:02:26,544 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2829be20116aa7e267be9144f381c0c1: 2023-09-19 20:02:26,545 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1695153745224.2829be20116aa7e267be9144f381c0c1., pid=77, masterSystemTime=1695153746488 2023-09-19 20:02:26,545 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1695153745224.2829be20116aa7e267be9144f381c0c1.,because compaction is disabled. 2023-09-19 20:02:26,547 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1695153745224.2829be20116aa7e267be9144f381c0c1. 2023-09-19 20:02:26,547 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1695153745224.2829be20116aa7e267be9144f381c0c1. 2023-09-19 20:02:26,547 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=2829be20116aa7e267be9144f381c0c1, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:26,547 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695153745224.2829be20116aa7e267be9144f381c0c1.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695153746547"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695153746547"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695153746547"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695153746547"}]},"ts":"1695153746547"} 2023-09-19 20:02:26,551 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=77, resume processing ppid=76 2023-09-19 20:02:26,551 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 2829be20116aa7e267be9144f381c0c1, server=jenkins-hbase4.apache.org,40839,1695153672784 in 213 msec 2023-09-19 20:02:26,552 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=76, resume processing ppid=71 2023-09-19 20:02:26,552 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2829be20116aa7e267be9144f381c0c1, ASSIGN in 373 msec 2023-09-19 20:02:26,554 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[0dda698ecce877963cf3ea88bfefa522, 13ee165a76077b4b937f3d97272d565d], force=true in 697 msec 2023-09-19 20:02:26,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-19 20:02:26,969 INFO [Listener at jenkins-hbase4.apache.org/45213] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-09-19 20:02:26,970 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-19 20:02:26,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695153746970 (current time:1695153746970). 2023-09-19 20:02:26,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-19 20:02:26,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] zookeeper.ReadOnlyZKClient(139): Connect 0x61262610 to 127.0.0.1:60323 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-19 20:02:26,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2abf5201, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-19 20:02:26,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 20:02:26,982 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34800, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 20:02:26,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x61262610 to 127.0.0.1:60323 2023-09-19 20:02:26,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 20:02:26,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] zookeeper.ReadOnlyZKClient(139): Connect 0x234cd8c0 to 127.0.0.1:60323 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-19 20:02:26,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@730a6c1f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-19 20:02:26,991 DEBUG [hconnection-0x23751725-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 20:02:26,993 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34804, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 20:02:26,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 20:02:27,000 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38332, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 20:02:27,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x234cd8c0 to 127.0.0.1:60323 2023-09-19 20:02:27,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 20:02:27,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-09-19 20:02:27,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-19 20:02:27,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-19 20:02:27,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] procedure2.ProcedureExecutor(1028): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-19 20:02:27,005 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-19 20:02:27,006 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1695154347006 2023-09-19 20:02:27,006 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-19 20:02:27,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-19 20:02:27,011 DEBUG [Listener at jenkins-hbase4.apache.org/45213] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-19 20:02:27,011 DEBUG [Listener at jenkins-hbase4.apache.org/45213] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-19 20:02:27,011 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-19 20:02:27,012 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-19 20:02:27,013 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 9 msec 2023-09-19 20:02:27,014 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-19 20:02:27,015 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1695154347015 2023-09-19 20:02:27,025 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 20:02:27,025 INFO [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-09-19 20:02:27,025 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 20:02:27,027 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-09-19 20:02:27,027 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-09-19 20:02:27,027 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 20:02:27,027 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 20:02:27,029 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 20:02:27,029 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:27,029 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 20:02:27,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 20:02:27,029 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 20:02:27,029 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 20:02:27,029 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 20:02:27,029 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 20:02:27,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 20:02:27,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 20:02:27,029 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:27,029 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-19 20:02:27,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 20:02:27,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 20:02:27,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 20:02:27,029 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 20:02:27,030 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 20:02:27,030 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 20:02:27,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-19 20:02:27,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 20:02:27,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-19 20:02:27,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 20:02:27,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-19 20:02:27,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 20:02:27,030 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-19 20:02:27,030 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-19 20:02:27,030 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-19 20:02:27,030 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 20:02:27,030 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 20:02:27,030 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 20:02:27,031 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-19 20:02:27,031 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 20:02:27,031 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-19 20:02:27,032 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-19 20:02:27,030 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-19 20:02:27,032 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-19 20:02:27,032 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 20:02:27,032 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40839,1695153672784' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-19 20:02:27,032 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 20:02:27,033 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-19 20:02:27,034 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-19 20:02:27,034 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-19 20:02:27,034 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-19 20:02:27,034 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45123,1695153672695' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-19 20:02:27,034 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40397,1695153672742' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-19 20:02:27,036 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:27,036 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 20:02:27,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:27,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 20:02:27,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 20:02:27,037 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 20:02:27,038 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 20:02:27,038 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 20:02:27,038 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 20:02:27,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 20:02:27,038 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 20:02:27,038 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 20:02:27,038 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 20:02:27,038 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 20:02:27,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 20:02:27,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 20:02:27,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:27,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:27,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:27,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 20:02:27,040 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40839,1695153672784' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-09-19 20:02:27,040 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2bc7e438[Count = 0] remaining members to acquire global barrier 2023-09-19 20:02:27,040 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-09-19 20:02:27,040 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 20:02:27,041 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 20:02:27,041 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 20:02:27,041 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 20:02:27,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 20:02:27,041 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 20:02:27,041 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-19 20:02:27,042 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 20:02:27,042 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:27,042 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-19 20:02:27,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 20:02:27,041 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 20:02:27,042 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-19 20:02:27,042 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-19 20:02:27,042 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,45123,1695153672695' in zk 2023-09-19 20:02:27,042 DEBUG [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1695153745224.2829be20116aa7e267be9144f381c0c1. 2023-09-19 20:02:27,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 20:02:27,042 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-19 20:02:27,042 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-19 20:02:27,042 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-19 20:02:27,042 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-19 20:02:27,042 DEBUG [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1695153745224.2829be20116aa7e267be9144f381c0c1. started... 2023-09-19 20:02:27,042 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,40397,1695153672742' in zk 2023-09-19 20:02:27,044 DEBUG [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2829be20116aa7e267be9144f381c0c1: 2023-09-19 20:02:27,044 DEBUG [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695153745224.2829be20116aa7e267be9144f381c0c1.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 20:02:27,044 DEBUG [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-19 20:02:27,045 DEBUG [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2829be20116aa7e267be9144f381c0c1/cf/76a4da8fd25f4af9aa042e6227dc010b.13ee165a76077b4b937f3d97272d565d->hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/13ee165a76077b4b937f3d97272d565d/cf/76a4da8fd25f4af9aa042e6227dc010b-top, hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2829be20116aa7e267be9144f381c0c1/cf/bac2504a7beb438497a5f48c1333fe00.0dda698ecce877963cf3ea88bfefa522->hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0dda698ecce877963cf3ea88bfefa522/cf/bac2504a7beb438497a5f48c1333fe00-top] hfiles 2023-09-19 20:02:27,045 DEBUG [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2829be20116aa7e267be9144f381c0c1/cf/76a4da8fd25f4af9aa042e6227dc010b.13ee165a76077b4b937f3d97272d565d for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 20:02:27,045 DEBUG [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2829be20116aa7e267be9144f381c0c1/cf/bac2504a7beb438497a5f48c1333fe00.0dda698ecce877963cf3ea88bfefa522 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 20:02:27,050 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-19 20:02:27,050 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 20:02:27,050 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-19 20:02:27,052 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-19 20:02:27,052 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 20:02:27,052 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-19 20:02:27,058 DEBUG [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1695153745224.2829be20116aa7e267be9144f381c0c1. completed. 2023-09-19 20:02:27,058 DEBUG [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1695153745224.2829be20116aa7e267be9144f381c0c1. 2023-09-19 20:02:27,058 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-19 20:02:27,058 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-19 20:02:27,058 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:27,058 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-19 20:02:27,058 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,40839,1695153672784' in zk 2023-09-19 20:02:27,063 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-19 20:02:27,063 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:27,063 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 20:02:27,063 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-19 20:02:27,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:27,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 20:02:27,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 20:02:27,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 20:02:27,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 20:02:27,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 20:02:27,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:27,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:27,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:27,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 20:02:27,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 20:02:27,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:27,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:27,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:27,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,40839,1695153672784': 2023-09-19 20:02:27,066 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40839,1695153672784' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-09-19 20:02:27,066 INFO [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-09-19 20:02:27,066 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-19 20:02:27,066 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-19 20:02:27,066 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 20:02:27,067 INFO [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-19 20:02:27,069 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 20:02:27,069 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 20:02:27,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 20:02:27,069 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 20:02:27,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 20:02:27,069 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 20:02:27,069 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 20:02:27,069 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 20:02:27,069 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 20:02:27,069 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 20:02:27,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 20:02:27,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 20:02:27,070 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:27,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 20:02:27,069 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 20:02:27,069 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 20:02:27,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 20:02:27,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 20:02:27,070 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 20:02:27,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 20:02:27,070 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:27,070 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 20:02:27,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 20:02:27,070 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 20:02:27,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 20:02:27,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 20:02:27,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 20:02:27,071 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:27,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 20:02:27,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 20:02:27,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 20:02:27,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 20:02:27,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:27,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:27,073 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:27,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:27,073 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:27,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 20:02:27,073 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:27,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 20:02:27,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:27,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:27,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:27,076 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 20:02:27,076 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 20:02:27,076 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 20:02:27,076 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 20:02:27,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 20:02:27,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 20:02:27,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 20:02:27,076 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 20:02:27,076 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 20:02:27,076 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 20:02:27,077 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 20:02:27,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 20:02:27,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 20:02:27,077 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 20:02:27,076 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 20:02:27,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 20:02:27,077 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:27,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 20:02:27,077 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 20:02:27,077 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:27,077 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:27,077 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 20:02:27,077 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:27,077 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 20:02:27,077 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:27,078 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:27,078 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 20:02:27,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 20:02:27,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 20:02:27,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 20:02:27,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 20:02:27,078 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 20:02:27,078 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 20:02:27,100 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 20:02:27,100 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-09-19 20:02:27,100 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 20:02:27,101 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 20:02:27,101 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1695153747006Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695153747077 (+71 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695153747077Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695153747081 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695153747093 (+12 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1695153747100 (+7 ms) 2023-09-19 20:02:27,103 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-19 20:02:27,105 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 94 msec 2023-09-19 20:02:27,111 DEBUG [Listener at jenkins-hbase4.apache.org/45213] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-19 20:02:27,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-09-19 20:02:27,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-19 20:02:27,112 INFO [Listener at jenkins-hbase4.apache.org/45213] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/export-test/export-1695153747112 2023-09-19 20:02:27,112 INFO [Listener at jenkins-hbase4.apache.org/45213] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:38739, tgtDir=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/export-test/export-1695153747112, rawTgtDir=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/export-test/export-1695153747112, srcFsUri=hdfs://localhost:38739, srcDir=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf 2023-09-19 20:02:27,143 DEBUG [Listener at jenkins-hbase4.apache.org/45213] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:38739, inputRoot=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf 2023-09-19 20:02:27,143 DEBUG [Listener at jenkins-hbase4.apache.org/45213] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1571208617_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/export-test/export-1695153747112, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/export-test/export-1695153747112/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 20:02:27,143 INFO [Listener at jenkins-hbase4.apache.org/45213] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:38739, inputRoot=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf, snapshotDir=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-09-19 20:02:27,193 INFO [Listener at jenkins-hbase4.apache.org/45213] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/export-test/export-1695153747112/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 20:02:27,213 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-19 20:02:27,214 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-19 20:02:27,214 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-19 20:02:27,214 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-19 20:02:28,091 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59/hadoop-5079345163066505293.jar 2023-09-19 20:02:28,092 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-19 20:02:28,092 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-19 20:02:28,159 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59/hadoop-4143579012439083723.jar 2023-09-19 20:02:28,159 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-19 20:02:28,160 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-19 20:02:28,160 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-19 20:02:28,161 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-19 20:02:28,161 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-19 20:02:28,161 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-19 20:02:28,162 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-19 20:02:28,162 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-19 20:02:28,162 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-19 20:02:28,163 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-19 20:02:28,163 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-19 20:02:28,163 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-19 20:02:28,164 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-19 20:02:28,164 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-19 20:02:28,164 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-19 20:02:28,165 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-19 20:02:28,165 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-19 20:02:28,166 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-19 20:02:28,166 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-19 20:02:28,167 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-19 20:02:28,167 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-19 20:02:28,167 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-19 20:02:28,168 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-19 20:02:28,360 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695153679175_0004_000001 (auth:SIMPLE) 2023-09-19 20:02:28,568 WARN [Listener at jenkins-hbase4.apache.org/45213] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-19 20:02:28,570 INFO [Listener at jenkins-hbase4.apache.org/45213] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-09-19 20:02:28,572 DEBUG [Listener at jenkins-hbase4.apache.org/45213] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-09-19 20:02:28,627 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-19 20:02:28,627 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-19 20:02:29,339 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-19 20:02:29,369 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695153679175_0005_000001 (auth:SIMPLE) 2023-09-19 20:02:33,073 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695153679175_0005_000001 (auth:SIMPLE) 2023-09-19 20:02:35,281 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695153679175_0005_000001 (auth:SIMPLE) 2023-09-19 20:02:37,600 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695153679175_0005_000001 (auth:SIMPLE) 2023-09-19 20:02:38,729 INFO [Listener at jenkins-hbase4.apache.org/45213] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-19 20:02:38,732 INFO [Listener at jenkins-hbase4.apache.org/45213] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-19 20:02:38,740 INFO [Listener at jenkins-hbase4.apache.org/45213] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 20:02:38,740 INFO [Listener at jenkins-hbase4.apache.org/45213] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-19 20:02:38,740 INFO [Listener at jenkins-hbase4.apache.org/45213] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-19 20:02:38,740 DEBUG [Listener at jenkins-hbase4.apache.org/45213] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1909323301_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 20:02:38,741 DEBUG [Listener at jenkins-hbase4.apache.org/45213] snapshot.TestExportSnapshot(367): hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-09-19 20:02:38,741 DEBUG [Listener at jenkins-hbase4.apache.org/45213] snapshot.TestExportSnapshot(367): hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-09-19 20:02:38,741 DEBUG [Listener at jenkins-hbase4.apache.org/45213] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1909323301_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/export-test/export-1695153747112/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/export-test/export-1695153747112/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 20:02:38,741 DEBUG [Listener at jenkins-hbase4.apache.org/45213] snapshot.TestExportSnapshot(367): hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/export-test/export-1695153747112/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-09-19 20:02:38,742 DEBUG [Listener at jenkins-hbase4.apache.org/45213] snapshot.TestExportSnapshot(367): hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/export-test/export-1695153747112/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-09-19 20:02:38,747 INFO [Listener at jenkins-hbase4.apache.org/45213] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-19 20:02:38,748 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-19 20:02:38,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] procedure2.ProcedureExecutor(1028): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-19 20:02:38,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-19 20:02:38,752 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695153758752"}]},"ts":"1695153758752"} 2023-09-19 20:02:38,753 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-09-19 20:02:38,755 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-09-19 20:02:38,755 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2829be20116aa7e267be9144f381c0c1, UNASSIGN}] 2023-09-19 20:02:38,757 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2829be20116aa7e267be9144f381c0c1, UNASSIGN 2023-09-19 20:02:38,758 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=2829be20116aa7e267be9144f381c0c1, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:38,758 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695153745224.2829be20116aa7e267be9144f381c0c1.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695153758758"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695153758758"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695153758758"}]},"ts":"1695153758758"} 2023-09-19 20:02:38,759 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 2829be20116aa7e267be9144f381c0c1, server=jenkins-hbase4.apache.org,40839,1695153672784}] 2023-09-19 20:02:38,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-19 20:02:38,911 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 2829be20116aa7e267be9144f381c0c1 2023-09-19 20:02:38,911 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2829be20116aa7e267be9144f381c0c1, disabling compactions & flushes 2023-09-19 20:02:38,911 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1695153745224.2829be20116aa7e267be9144f381c0c1. 2023-09-19 20:02:38,911 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695153745224.2829be20116aa7e267be9144f381c0c1. 2023-09-19 20:02:38,911 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695153745224.2829be20116aa7e267be9144f381c0c1. after waiting 0 ms 2023-09-19 20:02:38,911 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1695153745224.2829be20116aa7e267be9144f381c0c1. 2023-09-19 20:02:38,922 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2829be20116aa7e267be9144f381c0c1/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-09-19 20:02:38,922 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-19 20:02:38,923 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1695153745224.2829be20116aa7e267be9144f381c0c1. 2023-09-19 20:02:38,923 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2829be20116aa7e267be9144f381c0c1: 2023-09-19 20:02:38,924 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 2829be20116aa7e267be9144f381c0c1 2023-09-19 20:02:38,925 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=2829be20116aa7e267be9144f381c0c1, regionState=CLOSED 2023-09-19 20:02:38,925 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695153745224.2829be20116aa7e267be9144f381c0c1.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695153758925"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695153758925"}]},"ts":"1695153758925"} 2023-09-19 20:02:38,927 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=82, resume processing ppid=81 2023-09-19 20:02:38,928 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 2829be20116aa7e267be9144f381c0c1, server=jenkins-hbase4.apache.org,40839,1695153672784 in 167 msec 2023-09-19 20:02:38,929 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=81, resume processing ppid=80 2023-09-19 20:02:38,929 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2829be20116aa7e267be9144f381c0c1, UNASSIGN in 173 msec 2023-09-19 20:02:38,930 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695153758930"}]},"ts":"1695153758930"} 2023-09-19 20:02:38,931 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-09-19 20:02:38,932 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-09-19 20:02:38,934 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 185 msec 2023-09-19 20:02:39,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-19 20:02:39,054 INFO [Listener at jenkins-hbase4.apache.org/45213] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-09-19 20:02:39,055 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-19 20:02:39,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] procedure2.ProcedureExecutor(1028): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-19 20:02:39,058 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-19 20:02:39,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-19 20:02:39,058 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-19 20:02:39,060 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40839] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-19 20:02:39,063 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2829be20116aa7e267be9144f381c0c1 2023-09-19 20:02:39,063 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0dda698ecce877963cf3ea88bfefa522 2023-09-19 20:02:39,063 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/13ee165a76077b4b937f3d97272d565d 2023-09-19 20:02:39,064 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-19 20:02:39,064 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-19 20:02:39,064 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-19 20:02:39,064 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-19 20:02:39,064 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-19 20:02:39,064 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-19 20:02:39,064 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-19 20:02:39,065 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-19 20:02:39,065 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-19 20:02:39,065 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-19 20:02:39,065 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 20:02:39,065 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-19 20:02:39,065 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 20:02:39,065 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 20:02:39,066 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-19 20:02:39,066 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2829be20116aa7e267be9144f381c0c1/cf, FileablePath, hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2829be20116aa7e267be9144f381c0c1/recovered.edits] 2023-09-19 20:02:39,066 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 20:02:39,066 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/13ee165a76077b4b937f3d97272d565d/cf, FileablePath, hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/13ee165a76077b4b937f3d97272d565d/recovered.edits] 2023-09-19 20:02:39,066 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-19 20:02:39,066 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-19 20:02:39,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-09-19 20:02:39,066 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0dda698ecce877963cf3ea88bfefa522/cf, FileablePath, hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0dda698ecce877963cf3ea88bfefa522/recovered.edits] 2023-09-19 20:02:39,067 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-19 20:02:39,067 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-19 20:02:39,071 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2829be20116aa7e267be9144f381c0c1/cf/76a4da8fd25f4af9aa042e6227dc010b.13ee165a76077b4b937f3d97272d565d to hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2829be20116aa7e267be9144f381c0c1/cf/76a4da8fd25f4af9aa042e6227dc010b.13ee165a76077b4b937f3d97272d565d 2023-09-19 20:02:39,071 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/13ee165a76077b4b937f3d97272d565d/cf/76a4da8fd25f4af9aa042e6227dc010b to hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/13ee165a76077b4b937f3d97272d565d/cf/76a4da8fd25f4af9aa042e6227dc010b 2023-09-19 20:02:39,071 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0dda698ecce877963cf3ea88bfefa522/cf/bac2504a7beb438497a5f48c1333fe00 to hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0dda698ecce877963cf3ea88bfefa522/cf/bac2504a7beb438497a5f48c1333fe00 2023-09-19 20:02:39,072 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2829be20116aa7e267be9144f381c0c1/cf/bac2504a7beb438497a5f48c1333fe00.0dda698ecce877963cf3ea88bfefa522 to hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2829be20116aa7e267be9144f381c0c1/cf/bac2504a7beb438497a5f48c1333fe00.0dda698ecce877963cf3ea88bfefa522 2023-09-19 20:02:39,075 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/13ee165a76077b4b937f3d97272d565d/recovered.edits/8.seqid to hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/13ee165a76077b4b937f3d97272d565d/recovered.edits/8.seqid 2023-09-19 20:02:39,075 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0dda698ecce877963cf3ea88bfefa522/recovered.edits/8.seqid to hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0dda698ecce877963cf3ea88bfefa522/recovered.edits/8.seqid 2023-09-19 20:02:39,075 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/13ee165a76077b4b937f3d97272d565d 2023-09-19 20:02:39,076 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0dda698ecce877963cf3ea88bfefa522 2023-09-19 20:02:39,076 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2829be20116aa7e267be9144f381c0c1/recovered.edits/12.seqid to hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2829be20116aa7e267be9144f381c0c1/recovered.edits/12.seqid 2023-09-19 20:02:39,077 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2829be20116aa7e267be9144f381c0c1 2023-09-19 20:02:39,077 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-09-19 20:02:39,079 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-19 20:02:39,081 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-09-19 20:02:39,083 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-09-19 20:02:39,084 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-19 20:02:39,084 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-09-19 20:02:39,084 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695153745224.2829be20116aa7e267be9144f381c0c1.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695153759084"}]},"ts":"9223372036854775807"} 2023-09-19 20:02:39,085 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-09-19 20:02:39,085 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 2829be20116aa7e267be9144f381c0c1, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695153745224.2829be20116aa7e267be9144f381c0c1.', STARTKEY => '', ENDKEY => ''}] 2023-09-19 20:02:39,085 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-09-19 20:02:39,085 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695153759085"}]},"ts":"9223372036854775807"} 2023-09-19 20:02:39,087 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-09-19 20:02:39,088 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-19 20:02:39,089 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 33 msec 2023-09-19 20:02:39,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-09-19 20:02:39,168 INFO [Listener at jenkins-hbase4.apache.org/45213] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-09-19 20:02:39,168 INFO [Listener at jenkins-hbase4.apache.org/45213] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:39,169 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:39,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] procedure2.ProcedureExecutor(1028): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:39,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-19 20:02:39,173 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695153759173"}]},"ts":"1695153759173"} 2023-09-19 20:02:39,174 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-09-19 20:02:39,176 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-09-19 20:02:39,177 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c9697c82f09580ee877f816315a7110a, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=21d5efa9d832e0188c4afe38817df632, UNASSIGN}] 2023-09-19 20:02:39,178 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c9697c82f09580ee877f816315a7110a, UNASSIGN 2023-09-19 20:02:39,179 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=21d5efa9d832e0188c4afe38817df632, UNASSIGN 2023-09-19 20:02:39,179 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=c9697c82f09580ee877f816315a7110a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:39,179 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=21d5efa9d832e0188c4afe38817df632, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:39,179 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695153744062.c9697c82f09580ee877f816315a7110a.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695153759179"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695153759179"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695153759179"}]},"ts":"1695153759179"} 2023-09-19 20:02:39,179 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695153744062.21d5efa9d832e0188c4afe38817df632.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695153759179"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695153759179"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695153759179"}]},"ts":"1695153759179"} 2023-09-19 20:02:39,181 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure c9697c82f09580ee877f816315a7110a, server=jenkins-hbase4.apache.org,40397,1695153672742}] 2023-09-19 20:02:39,182 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure 21d5efa9d832e0188c4afe38817df632, server=jenkins-hbase4.apache.org,40839,1695153672784}] 2023-09-19 20:02:39,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-19 20:02:39,333 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c9697c82f09580ee877f816315a7110a 2023-09-19 20:02:39,333 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c9697c82f09580ee877f816315a7110a, disabling compactions & flushes 2023-09-19 20:02:39,333 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1695153744062.c9697c82f09580ee877f816315a7110a. 2023-09-19 20:02:39,333 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695153744062.c9697c82f09580ee877f816315a7110a. 2023-09-19 20:02:39,333 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695153744062.c9697c82f09580ee877f816315a7110a. after waiting 0 ms 2023-09-19 20:02:39,333 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1695153744062.c9697c82f09580ee877f816315a7110a. 2023-09-19 20:02:39,337 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 21d5efa9d832e0188c4afe38817df632 2023-09-19 20:02:39,337 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 21d5efa9d832e0188c4afe38817df632, disabling compactions & flushes 2023-09-19 20:02:39,337 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1695153744062.21d5efa9d832e0188c4afe38817df632. 2023-09-19 20:02:39,337 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695153744062.21d5efa9d832e0188c4afe38817df632. 2023-09-19 20:02:39,337 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695153744062.21d5efa9d832e0188c4afe38817df632. after waiting 0 ms 2023-09-19 20:02:39,337 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1695153744062.21d5efa9d832e0188c4afe38817df632. 2023-09-19 20:02:39,344 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemStateWithMergeRegion/c9697c82f09580ee877f816315a7110a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-19 20:02:39,344 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemStateWithMergeRegion/21d5efa9d832e0188c4afe38817df632/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-19 20:02:39,344 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-19 20:02:39,345 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-19 20:02:39,346 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1695153744062.21d5efa9d832e0188c4afe38817df632. 2023-09-19 20:02:39,346 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 21d5efa9d832e0188c4afe38817df632: 2023-09-19 20:02:39,346 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1695153744062.c9697c82f09580ee877f816315a7110a. 2023-09-19 20:02:39,346 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c9697c82f09580ee877f816315a7110a: 2023-09-19 20:02:39,348 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 21d5efa9d832e0188c4afe38817df632 2023-09-19 20:02:39,348 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=21d5efa9d832e0188c4afe38817df632, regionState=CLOSED 2023-09-19 20:02:39,348 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c9697c82f09580ee877f816315a7110a 2023-09-19 20:02:39,348 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695153744062.21d5efa9d832e0188c4afe38817df632.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695153759348"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695153759348"}]},"ts":"1695153759348"} 2023-09-19 20:02:39,349 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=c9697c82f09580ee877f816315a7110a, regionState=CLOSED 2023-09-19 20:02:39,349 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695153744062.c9697c82f09580ee877f816315a7110a.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695153759349"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695153759349"}]},"ts":"1695153759349"} 2023-09-19 20:02:39,351 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=88, resume processing ppid=86 2023-09-19 20:02:39,351 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure 21d5efa9d832e0188c4afe38817df632, server=jenkins-hbase4.apache.org,40839,1695153672784 in 168 msec 2023-09-19 20:02:39,352 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=87, resume processing ppid=85 2023-09-19 20:02:39,352 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure c9697c82f09580ee877f816315a7110a, server=jenkins-hbase4.apache.org,40397,1695153672742 in 169 msec 2023-09-19 20:02:39,352 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=21d5efa9d832e0188c4afe38817df632, UNASSIGN in 175 msec 2023-09-19 20:02:39,353 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=85, resume processing ppid=84 2023-09-19 20:02:39,353 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c9697c82f09580ee877f816315a7110a, UNASSIGN in 176 msec 2023-09-19 20:02:39,353 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695153759353"}]},"ts":"1695153759353"} 2023-09-19 20:02:39,355 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-09-19 20:02:39,357 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-09-19 20:02:39,358 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 188 msec 2023-09-19 20:02:39,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-19 20:02:39,475 INFO [Listener at jenkins-hbase4.apache.org/45213] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-09-19 20:02:39,476 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:39,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] procedure2.ProcedureExecutor(1028): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:39,479 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:39,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:39,480 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:39,481 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40839] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:39,483 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:39,484 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:39,484 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:39,484 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:39,484 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-19 20:02:39,484 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-19 20:02:39,484 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-19 20:02:39,484 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-19 20:02:39,484 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/21d5efa9d832e0188c4afe38817df632 2023-09-19 20:02:39,484 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c9697c82f09580ee877f816315a7110a 2023-09-19 20:02:39,485 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:39,485 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 20:02:39,485 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:39,485 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 20:02:39,485 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:39,485 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:39,486 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 20:02:39,486 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 20:02:39,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-09-19 20:02:39,487 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c9697c82f09580ee877f816315a7110a/cf, FileablePath, hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c9697c82f09580ee877f816315a7110a/recovered.edits] 2023-09-19 20:02:39,487 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/21d5efa9d832e0188c4afe38817df632/cf, FileablePath, hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/21d5efa9d832e0188c4afe38817df632/recovered.edits] 2023-09-19 20:02:39,491 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c9697c82f09580ee877f816315a7110a/cf/8d6a0c336cf3425eb04fbbe51a824621 to hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/c9697c82f09580ee877f816315a7110a/cf/8d6a0c336cf3425eb04fbbe51a824621 2023-09-19 20:02:39,491 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/21d5efa9d832e0188c4afe38817df632/cf/38b47a1a8c7d43b783abe82c0602eff8 to hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/21d5efa9d832e0188c4afe38817df632/cf/38b47a1a8c7d43b783abe82c0602eff8 2023-09-19 20:02:39,494 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c9697c82f09580ee877f816315a7110a/recovered.edits/9.seqid to hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/c9697c82f09580ee877f816315a7110a/recovered.edits/9.seqid 2023-09-19 20:02:39,494 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/21d5efa9d832e0188c4afe38817df632/recovered.edits/9.seqid to hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/21d5efa9d832e0188c4afe38817df632/recovered.edits/9.seqid 2023-09-19 20:02:39,495 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c9697c82f09580ee877f816315a7110a 2023-09-19 20:02:39,495 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/21d5efa9d832e0188c4afe38817df632 2023-09-19 20:02:39,495 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-09-19 20:02:39,495 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-09-19 20:02:39,496 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-09-19 20:02:39,499 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202309190ed059c7c0ae43bbbc3582c4b32e1d63 to hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202309190ed059c7c0ae43bbbc3582c4b32e1d63 2023-09-19 20:02:39,500 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230919558fafe914644af19c945408ca5887e5 to hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230919558fafe914644af19c945408ca5887e5 2023-09-19 20:02:39,501 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-09-19 20:02:39,503 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:39,504 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-09-19 20:02:39,506 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-09-19 20:02:39,507 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:39,507 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-09-19 20:02:39,507 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695153744062.c9697c82f09580ee877f816315a7110a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695153759507"}]},"ts":"9223372036854775807"} 2023-09-19 20:02:39,507 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695153744062.21d5efa9d832e0188c4afe38817df632.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695153759507"}]},"ts":"9223372036854775807"} 2023-09-19 20:02:39,509 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-19 20:02:39,509 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => c9697c82f09580ee877f816315a7110a, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1695153744062.c9697c82f09580ee877f816315a7110a.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 21d5efa9d832e0188c4afe38817df632, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1695153744062.21d5efa9d832e0188c4afe38817df632.', STARTKEY => '1', ENDKEY => ''}] 2023-09-19 20:02:39,509 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-09-19 20:02:39,509 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695153759509"}]},"ts":"9223372036854775807"} 2023-09-19 20:02:39,510 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-09-19 20:02:39,514 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:39,515 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 38 msec 2023-09-19 20:02:39,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-09-19 20:02:39,588 INFO [Listener at jenkins-hbase4.apache.org/45213] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-09-19 20:02:39,597 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-09-19 20:02:39,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:39,600 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-09-19 20:02:39,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 20:02:39,602 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-09-19 20:02:39,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 20:02:39,628 INFO [Listener at jenkins-hbase4.apache.org/45213] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=762 (was 752) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1909323301_17 at /127.0.0.1:56582 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x51b5961f-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1909323301_17 at /127.0.0.1:56596 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1856159500_1 at /127.0.0.1:33824 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4071 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x51b5961f-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1909323301_17 at /127.0.0.1:33844 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1909323301_17 at /127.0.0.1:39020 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x51b5961f-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1856159500_1 at /127.0.0.1:56576 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x51b5961f-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1781244183) connection to jenkins-hbase4.apache.org/172.31.14.131:40697 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x51b5961f-shared-pool-27 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x51b5961f-shared-pool-28 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=916 (was 908) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=212 (was 243), ProcessCount=168 (was 168), AvailableMemoryMB=7540 (was 7621) 2023-09-19 20:02:39,628 WARN [Listener at jenkins-hbase4.apache.org/45213] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-09-19 20:02:39,646 INFO [Listener at jenkins-hbase4.apache.org/45213] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=762, OpenFileDescriptor=916, MaxFileDescriptor=60000, SystemLoadAverage=212, ProcessCount=168, AvailableMemoryMB=7539 2023-09-19 20:02:39,646 WARN [Listener at jenkins-hbase4.apache.org/45213] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-09-19 20:02:39,648 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-19 20:02:39,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] procedure2.ProcedureExecutor(1028): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-19 20:02:39,651 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-09-19 20:02:39,651 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-09-19 20:02:39,651 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-19 20:02:39,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-19 20:02:39,653 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testEmptyExportFileSystemState/a43b1ec0b84074e7afda96112ccfa6cd 2023-09-19 20:02:39,653 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testEmptyExportFileSystemState/678a7789310227b4ffc0582158de6097 2023-09-19 20:02:39,654 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testEmptyExportFileSystemState/a43b1ec0b84074e7afda96112ccfa6cd empty. 2023-09-19 20:02:39,654 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testEmptyExportFileSystemState/678a7789310227b4ffc0582158de6097 empty. 2023-09-19 20:02:39,654 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testEmptyExportFileSystemState/a43b1ec0b84074e7afda96112ccfa6cd 2023-09-19 20:02:39,654 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testEmptyExportFileSystemState/678a7789310227b4ffc0582158de6097 2023-09-19 20:02:39,654 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-09-19 20:02:39,663 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-09-19 20:02:39,664 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => a43b1ec0b84074e7afda96112ccfa6cd, NAME => 'testtb-testEmptyExportFileSystemState,,1695153759648.a43b1ec0b84074e7afda96112ccfa6cd.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp 2023-09-19 20:02:39,664 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 678a7789310227b4ffc0582158de6097, NAME => 'testtb-testEmptyExportFileSystemState,1,1695153759648.678a7789310227b4ffc0582158de6097.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp 2023-09-19 20:02:39,672 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1695153759648.a43b1ec0b84074e7afda96112ccfa6cd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 20:02:39,672 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1695153759648.678a7789310227b4ffc0582158de6097.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 20:02:39,673 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing a43b1ec0b84074e7afda96112ccfa6cd, disabling compactions & flushes 2023-09-19 20:02:39,673 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 678a7789310227b4ffc0582158de6097, disabling compactions & flushes 2023-09-19 20:02:39,673 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1695153759648.a43b1ec0b84074e7afda96112ccfa6cd. 2023-09-19 20:02:39,673 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1695153759648.678a7789310227b4ffc0582158de6097. 2023-09-19 20:02:39,673 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1695153759648.a43b1ec0b84074e7afda96112ccfa6cd. 2023-09-19 20:02:39,673 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1695153759648.678a7789310227b4ffc0582158de6097. 2023-09-19 20:02:39,673 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1695153759648.a43b1ec0b84074e7afda96112ccfa6cd. after waiting 0 ms 2023-09-19 20:02:39,673 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1695153759648.678a7789310227b4ffc0582158de6097. after waiting 0 ms 2023-09-19 20:02:39,673 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1695153759648.a43b1ec0b84074e7afda96112ccfa6cd. 2023-09-19 20:02:39,673 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1695153759648.678a7789310227b4ffc0582158de6097. 2023-09-19 20:02:39,673 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1695153759648.a43b1ec0b84074e7afda96112ccfa6cd. 2023-09-19 20:02:39,673 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1695153759648.678a7789310227b4ffc0582158de6097. 2023-09-19 20:02:39,673 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for a43b1ec0b84074e7afda96112ccfa6cd: 2023-09-19 20:02:39,673 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 678a7789310227b4ffc0582158de6097: 2023-09-19 20:02:39,675 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-09-19 20:02:39,676 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1695153759648.a43b1ec0b84074e7afda96112ccfa6cd.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695153759676"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695153759676"}]},"ts":"1695153759676"} 2023-09-19 20:02:39,676 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1695153759648.678a7789310227b4ffc0582158de6097.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695153759676"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695153759676"}]},"ts":"1695153759676"} 2023-09-19 20:02:39,678 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-19 20:02:39,679 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-19 20:02:39,679 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695153759679"}]},"ts":"1695153759679"} 2023-09-19 20:02:39,680 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-09-19 20:02:39,683 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-19 20:02:39,684 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-19 20:02:39,684 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-19 20:02:39,684 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-19 20:02:39,684 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-19 20:02:39,684 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=a43b1ec0b84074e7afda96112ccfa6cd, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=678a7789310227b4ffc0582158de6097, ASSIGN}] 2023-09-19 20:02:39,687 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=678a7789310227b4ffc0582158de6097, ASSIGN 2023-09-19 20:02:39,687 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=a43b1ec0b84074e7afda96112ccfa6cd, ASSIGN 2023-09-19 20:02:39,687 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=678a7789310227b4ffc0582158de6097, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40839,1695153672784; forceNewPlan=false, retain=false 2023-09-19 20:02:39,687 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=a43b1ec0b84074e7afda96112ccfa6cd, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40397,1695153672742; forceNewPlan=false, retain=false 2023-09-19 20:02:39,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-19 20:02:39,838 INFO [jenkins-hbase4:37929] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-19 20:02:39,840 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=a43b1ec0b84074e7afda96112ccfa6cd, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:39,840 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=678a7789310227b4ffc0582158de6097, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:39,840 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1695153759648.a43b1ec0b84074e7afda96112ccfa6cd.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695153759840"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695153759840"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695153759840"}]},"ts":"1695153759840"} 2023-09-19 20:02:39,840 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1695153759648.678a7789310227b4ffc0582158de6097.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695153759840"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695153759840"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695153759840"}]},"ts":"1695153759840"} 2023-09-19 20:02:39,842 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; OpenRegionProcedure a43b1ec0b84074e7afda96112ccfa6cd, server=jenkins-hbase4.apache.org,40397,1695153672742}] 2023-09-19 20:02:39,843 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=94, ppid=92, state=RUNNABLE; OpenRegionProcedure 678a7789310227b4ffc0582158de6097, server=jenkins-hbase4.apache.org,40839,1695153672784}] 2023-09-19 20:02:39,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-19 20:02:39,996 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1695153759648.a43b1ec0b84074e7afda96112ccfa6cd. 2023-09-19 20:02:39,997 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a43b1ec0b84074e7afda96112ccfa6cd, NAME => 'testtb-testEmptyExportFileSystemState,,1695153759648.a43b1ec0b84074e7afda96112ccfa6cd.', STARTKEY => '', ENDKEY => '1'} 2023-09-19 20:02:39,997 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1695153759648.678a7789310227b4ffc0582158de6097. 2023-09-19 20:02:39,997 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 678a7789310227b4ffc0582158de6097, NAME => 'testtb-testEmptyExportFileSystemState,1,1695153759648.678a7789310227b4ffc0582158de6097.', STARTKEY => '1', ENDKEY => ''} 2023-09-19 20:02:39,997 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1695153759648.a43b1ec0b84074e7afda96112ccfa6cd. service=AccessControlService 2023-09-19 20:02:39,998 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-19 20:02:39,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1695153759648.678a7789310227b4ffc0582158de6097. service=AccessControlService 2023-09-19 20:02:39,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState a43b1ec0b84074e7afda96112ccfa6cd 2023-09-19 20:02:39,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1695153759648.a43b1ec0b84074e7afda96112ccfa6cd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 20:02:39,998 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-19 20:02:39,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a43b1ec0b84074e7afda96112ccfa6cd 2023-09-19 20:02:39,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a43b1ec0b84074e7afda96112ccfa6cd 2023-09-19 20:02:39,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 678a7789310227b4ffc0582158de6097 2023-09-19 20:02:39,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1695153759648.678a7789310227b4ffc0582158de6097.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 20:02:39,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 678a7789310227b4ffc0582158de6097 2023-09-19 20:02:39,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 678a7789310227b4ffc0582158de6097 2023-09-19 20:02:39,999 INFO [StoreOpener-a43b1ec0b84074e7afda96112ccfa6cd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a43b1ec0b84074e7afda96112ccfa6cd 2023-09-19 20:02:39,999 INFO [StoreOpener-678a7789310227b4ffc0582158de6097-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 678a7789310227b4ffc0582158de6097 2023-09-19 20:02:40,000 DEBUG [StoreOpener-a43b1ec0b84074e7afda96112ccfa6cd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testEmptyExportFileSystemState/a43b1ec0b84074e7afda96112ccfa6cd/cf 2023-09-19 20:02:40,000 DEBUG [StoreOpener-a43b1ec0b84074e7afda96112ccfa6cd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testEmptyExportFileSystemState/a43b1ec0b84074e7afda96112ccfa6cd/cf 2023-09-19 20:02:40,000 DEBUG [StoreOpener-678a7789310227b4ffc0582158de6097-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testEmptyExportFileSystemState/678a7789310227b4ffc0582158de6097/cf 2023-09-19 20:02:40,001 DEBUG [StoreOpener-678a7789310227b4ffc0582158de6097-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testEmptyExportFileSystemState/678a7789310227b4ffc0582158de6097/cf 2023-09-19 20:02:40,001 INFO [StoreOpener-a43b1ec0b84074e7afda96112ccfa6cd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a43b1ec0b84074e7afda96112ccfa6cd columnFamilyName cf 2023-09-19 20:02:40,001 INFO [StoreOpener-678a7789310227b4ffc0582158de6097-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 678a7789310227b4ffc0582158de6097 columnFamilyName cf 2023-09-19 20:02:40,002 INFO [StoreOpener-678a7789310227b4ffc0582158de6097-1] regionserver.HStore(310): Store=678a7789310227b4ffc0582158de6097/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-19 20:02:40,002 INFO [StoreOpener-a43b1ec0b84074e7afda96112ccfa6cd-1] regionserver.HStore(310): Store=a43b1ec0b84074e7afda96112ccfa6cd/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-19 20:02:40,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testEmptyExportFileSystemState/a43b1ec0b84074e7afda96112ccfa6cd 2023-09-19 20:02:40,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testEmptyExportFileSystemState/678a7789310227b4ffc0582158de6097 2023-09-19 20:02:40,004 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testEmptyExportFileSystemState/a43b1ec0b84074e7afda96112ccfa6cd 2023-09-19 20:02:40,004 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testEmptyExportFileSystemState/678a7789310227b4ffc0582158de6097 2023-09-19 20:02:40,006 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a43b1ec0b84074e7afda96112ccfa6cd 2023-09-19 20:02:40,006 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 678a7789310227b4ffc0582158de6097 2023-09-19 20:02:40,008 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testEmptyExportFileSystemState/a43b1ec0b84074e7afda96112ccfa6cd/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-19 20:02:40,008 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testEmptyExportFileSystemState/678a7789310227b4ffc0582158de6097/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-19 20:02:40,008 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a43b1ec0b84074e7afda96112ccfa6cd; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72904558, jitterRate=0.0863625705242157}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-19 20:02:40,009 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a43b1ec0b84074e7afda96112ccfa6cd: 2023-09-19 20:02:40,009 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 678a7789310227b4ffc0582158de6097; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72229985, jitterRate=0.0763106495141983}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-19 20:02:40,009 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 678a7789310227b4ffc0582158de6097: 2023-09-19 20:02:40,009 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1695153759648.a43b1ec0b84074e7afda96112ccfa6cd., pid=93, masterSystemTime=1695153759993 2023-09-19 20:02:40,009 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1695153759648.678a7789310227b4ffc0582158de6097., pid=94, masterSystemTime=1695153759995 2023-09-19 20:02:40,010 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1695153759648.a43b1ec0b84074e7afda96112ccfa6cd. 2023-09-19 20:02:40,011 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1695153759648.a43b1ec0b84074e7afda96112ccfa6cd. 2023-09-19 20:02:40,011 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=a43b1ec0b84074e7afda96112ccfa6cd, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:40,011 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1695153759648.a43b1ec0b84074e7afda96112ccfa6cd.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695153760011"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695153760011"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695153760011"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695153760011"}]},"ts":"1695153760011"} 2023-09-19 20:02:40,011 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1695153759648.678a7789310227b4ffc0582158de6097. 2023-09-19 20:02:40,011 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1695153759648.678a7789310227b4ffc0582158de6097. 2023-09-19 20:02:40,012 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=678a7789310227b4ffc0582158de6097, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:40,012 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1695153759648.678a7789310227b4ffc0582158de6097.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695153760011"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695153760011"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695153760011"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695153760011"}]},"ts":"1695153760011"} 2023-09-19 20:02:40,014 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=93, resume processing ppid=91 2023-09-19 20:02:40,014 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=93, ppid=91, state=SUCCESS; OpenRegionProcedure a43b1ec0b84074e7afda96112ccfa6cd, server=jenkins-hbase4.apache.org,40397,1695153672742 in 170 msec 2023-09-19 20:02:40,015 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=94, resume processing ppid=92 2023-09-19 20:02:40,015 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=94, ppid=92, state=SUCCESS; OpenRegionProcedure 678a7789310227b4ffc0582158de6097, server=jenkins-hbase4.apache.org,40839,1695153672784 in 170 msec 2023-09-19 20:02:40,015 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=a43b1ec0b84074e7afda96112ccfa6cd, ASSIGN in 330 msec 2023-09-19 20:02:40,016 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=92, resume processing ppid=90 2023-09-19 20:02:40,017 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=678a7789310227b4ffc0582158de6097, ASSIGN in 331 msec 2023-09-19 20:02:40,017 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-19 20:02:40,017 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695153760017"}]},"ts":"1695153760017"} 2023-09-19 20:02:40,018 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-09-19 20:02:40,020 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-09-19 20:02:40,021 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-09-19 20:02:40,022 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40839] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-19 20:02:40,024 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 20:02:40,024 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 20:02:40,024 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 20:02:40,024 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 20:02:40,025 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-19 20:02:40,025 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-19 20:02:40,025 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-19 20:02:40,026 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-19 20:02:40,026 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 377 msec 2023-09-19 20:02:40,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-19 20:02:40,255 INFO [Listener at jenkins-hbase4.apache.org/45213] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-09-19 20:02:40,257 DEBUG [Listener at jenkins-hbase4.apache.org/45213] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-09-19 20:02:40,257 DEBUG [Listener at jenkins-hbase4.apache.org/45213] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1695153759648.a43b1ec0b84074e7afda96112ccfa6cd. 2023-09-19 20:02:40,259 INFO [Listener at jenkins-hbase4.apache.org/45213] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-19 20:02:40,269 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-19 20:02:40,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695153760269 (current time:1695153760269). 2023-09-19 20:02:40,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-19 20:02:40,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] zookeeper.ReadOnlyZKClient(139): Connect 0x27c20d40 to 127.0.0.1:60323 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-19 20:02:40,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@445f2c4e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-19 20:02:40,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 20:02:40,281 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47290, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 20:02:40,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x27c20d40 to 127.0.0.1:60323 2023-09-19 20:02:40,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 20:02:40,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] zookeeper.ReadOnlyZKClient(139): Connect 0x63d23579 to 127.0.0.1:60323 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-19 20:02:40,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@544d9c4e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-19 20:02:40,290 DEBUG [hconnection-0x694df7d5-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 20:02:40,292 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47302, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 20:02:40,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 20:02:40,296 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59688, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 20:02:40,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x63d23579 to 127.0.0.1:60323 2023-09-19 20:02:40,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 20:02:40,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-19 20:02:40,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-19 20:02:40,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-19 20:02:40,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] procedure2.ProcedureExecutor(1028): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-19 20:02:40,301 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-19 20:02:40,302 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695154360302 2023-09-19 20:02:40,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-19 20:02:40,302 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-09-19 20:02:40,303 DEBUG [Listener at jenkins-hbase4.apache.org/45213] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-19 20:02:40,303 DEBUG [Listener at jenkins-hbase4.apache.org/45213] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-19 20:02:40,304 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-19 20:02:40,304 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-19 20:02:40,305 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-09-19 20:02:40,308 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-19 20:02:40,308 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695154360308 2023-09-19 20:02:40,316 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,317 INFO [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-09-19 20:02:40,317 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 20:02:40,318 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-09-19 20:02:40,318 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-09-19 20:02:40,318 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,318 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,325 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 20:02:40,325 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:40,325 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 20:02:40,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 20:02:40,325 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 20:02:40,325 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 20:02:40,325 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 20:02:40,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 20:02:40,325 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 20:02:40,325 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:40,325 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:40,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 20:02:40,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,326 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:40,326 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-19 20:02:40,326 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,326 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,326 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-19 20:02:40,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-19 20:02:40,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,326 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-19 20:02:40,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-19 20:02:40,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,326 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-19 20:02:40,327 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-19 20:02:40,327 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,327 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-19 20:02:40,327 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,327 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 20:02:40,327 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-19 20:02:40,328 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 20:02:40,327 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,329 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-19 20:02:40,328 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-19 20:02:40,329 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-19 20:02:40,329 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-19 20:02:40,329 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45123,1695153672695' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-19 20:02:40,329 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-19 20:02:40,329 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40397,1695153672742' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-19 20:02:40,329 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 20:02:40,330 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-19 20:02:40,330 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-19 20:02:40,330 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40839,1695153672784' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-19 20:02:40,332 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,332 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,332 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:40,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:40,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 20:02:40,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 20:02:40,333 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:40,333 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 20:02:40,333 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,333 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 20:02:40,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 20:02:40,334 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,334 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 20:02:40,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:40,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:40,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:40,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 20:02:40,335 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40397,1695153672742' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-19 20:02:40,335 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3c2df955[Count = 1] remaining members to acquire global barrier 2023-09-19 20:02:40,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:40,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 20:02:40,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 20:02:40,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 20:02:40,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 20:02:40,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,337 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,337 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 20:02:40,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:40,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:40,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:40,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 20:02:40,338 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40839,1695153672784' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-19 20:02:40,338 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3c2df955[Count = 0] remaining members to acquire global barrier 2023-09-19 20:02:40,338 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-09-19 20:02:40,338 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,341 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,341 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,341 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,341 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,341 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,341 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:40,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,341 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,341 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-19 20:02:40,341 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-19 20:02:40,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,342 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-19 20:02:40,342 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-19 20:02:40,342 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:40,342 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-19 20:02:40,341 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45123,1695153672695' in zk 2023-09-19 20:02:40,342 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-19 20:02:40,342 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-19 20:02:40,342 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-19 20:02:40,342 DEBUG [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1695153759648.678a7789310227b4ffc0582158de6097. 2023-09-19 20:02:40,342 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-19 20:02:40,342 DEBUG [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695153759648.678a7789310227b4ffc0582158de6097. started... 2023-09-19 20:02:40,342 DEBUG [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1695153759648.a43b1ec0b84074e7afda96112ccfa6cd. 2023-09-19 20:02:40,342 DEBUG [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695153759648.a43b1ec0b84074e7afda96112ccfa6cd. started... 2023-09-19 20:02:40,343 DEBUG [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a43b1ec0b84074e7afda96112ccfa6cd: 2023-09-19 20:02:40,343 DEBUG [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 678a7789310227b4ffc0582158de6097: 2023-09-19 20:02:40,344 DEBUG [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1695153759648.a43b1ec0b84074e7afda96112ccfa6cd.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,344 DEBUG [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1695153759648.678a7789310227b4ffc0582158de6097.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,344 DEBUG [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-19 20:02:40,344 DEBUG [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-19 20:02:40,344 DEBUG [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-19 20:02:40,344 DEBUG [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-19 20:02:40,344 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-19 20:02:40,345 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 20:02:40,345 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-19 20:02:40,357 DEBUG [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695153759648.a43b1ec0b84074e7afda96112ccfa6cd. completed. 2023-09-19 20:02:40,357 DEBUG [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1695153759648.a43b1ec0b84074e7afda96112ccfa6cd. 2023-09-19 20:02:40,357 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-19 20:02:40,357 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-19 20:02:40,357 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:40,357 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-19 20:02:40,357 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40397,1695153672742' in zk 2023-09-19 20:02:40,359 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-19 20:02:40,359 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 20:02:40,359 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:40,359 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-19 20:02:40,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:40,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 20:02:40,360 DEBUG [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695153759648.678a7789310227b4ffc0582158de6097. completed. 2023-09-19 20:02:40,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 20:02:40,360 DEBUG [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1695153759648.678a7789310227b4ffc0582158de6097. 2023-09-19 20:02:40,360 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-19 20:02:40,360 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-19 20:02:40,360 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:40,360 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-19 20:02:40,360 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40839,1695153672784' in zk 2023-09-19 20:02:40,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 20:02:40,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 20:02:40,362 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:40,362 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-19 20:02:40,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,362 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 20:02:40,362 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-19 20:02:40,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:40,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:40,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:40,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 20:02:40,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:40,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:40,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:40,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,40397,1695153672742': 2023-09-19 20:02:40,365 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40397,1695153672742' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-19 20:02:40,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:40,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 20:02:40,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 20:02:40,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 20:02:40,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 20:02:40,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:40,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:40,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:40,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 20:02:40,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:40,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:40,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:40,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,40839,1695153672784': 2023-09-19 20:02:40,368 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40839,1695153672784' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-19 20:02:40,368 INFO [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-09-19 20:02:40,368 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-19 20:02:40,368 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-19 20:02:40,368 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,368 INFO [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-19 20:02:40,370 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,370 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 20:02:40,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 20:02:40,370 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,370 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,370 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 20:02:40,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,370 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 20:02:40,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 20:02:40,370 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 20:02:40,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,371 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:40,371 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 20:02:40,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 20:02:40,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,371 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 20:02:40,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 20:02:40,371 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:40,371 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 20:02:40,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 20:02:40,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 20:02:40,371 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:40,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:40,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:40,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:40,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 20:02:40,373 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:40,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,373 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:40,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:40,374 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:40,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:40,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:40,376 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:40,376 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,376 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:40,376 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 20:02:40,376 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 20:02:40,376 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 20:02:40,376 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:40,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 20:02:40,376 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 20:02:40,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 20:02:40,377 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 20:02:40,376 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 20:02:40,376 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 20:02:40,376 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 20:02:40,378 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 20:02:40,378 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 20:02:40,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 20:02:40,378 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 20:02:40,377 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,376 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,378 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-09-19 20:02:40,378 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:40,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 20:02:40,378 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 20:02:40,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 20:02:40,378 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 20:02:40,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 20:02:40,378 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,378 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,378 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-19 20:02:40,378 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:40,378 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:40,378 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,378 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,379 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-19 20:02:40,385 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,387 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,402 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,402 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-09-19 20:02:40,402 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,403 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,403 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1695153760302Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1695153760385 (+83 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1695153760385Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1695153760385Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1695153760390 (+5 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1695153760397 (+7 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1695153760402 (+5 ms) 2023-09-19 20:02:40,404 DEBUG [Listener at jenkins-hbase4.apache.org/45213] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-19 20:02:40,406 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-19 20:02:40,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-19 20:02:40,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-19 20:02:40,407 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 103 msec 2023-09-19 20:02:40,409 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40397] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1695153759648.a43b1ec0b84074e7afda96112ccfa6cd. with WAL disabled. Data may be lost in the event of a crash. 2023-09-19 20:02:40,409 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40839] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1695153759648.678a7789310227b4ffc0582158de6097. with WAL disabled. Data may be lost in the event of a crash. 2023-09-19 20:02:40,412 DEBUG [Listener at jenkins-hbase4.apache.org/45213] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-09-19 20:02:40,412 DEBUG [Listener at jenkins-hbase4.apache.org/45213] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1695153759648.a43b1ec0b84074e7afda96112ccfa6cd. 2023-09-19 20:02:40,412 INFO [Listener at jenkins-hbase4.apache.org/45213] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-19 20:02:40,420 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-19 20:02:40,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695153760421 (current time:1695153760421). 2023-09-19 20:02:40,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-19 20:02:40,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] zookeeper.ReadOnlyZKClient(139): Connect 0x461269be to 127.0.0.1:60323 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-19 20:02:40,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@40e7cdf6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-19 20:02:40,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 20:02:40,432 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47314, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 20:02:40,433 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x461269be to 127.0.0.1:60323 2023-09-19 20:02:40,433 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 20:02:40,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] zookeeper.ReadOnlyZKClient(139): Connect 0x6e6a4c60 to 127.0.0.1:60323 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-19 20:02:40,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3be0978a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-19 20:02:40,441 DEBUG [hconnection-0x4516657d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 20:02:40,442 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47318, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 20:02:40,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 20:02:40,448 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59694, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 20:02:40,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6e6a4c60 to 127.0.0.1:60323 2023-09-19 20:02:40,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 20:02:40,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-19 20:02:40,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-19 20:02:40,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-19 20:02:40,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] procedure2.ProcedureExecutor(1028): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-19 20:02:40,453 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-19 20:02:40,454 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695154360454 2023-09-19 20:02:40,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-19 20:02:40,454 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-09-19 20:02:40,455 DEBUG [Listener at jenkins-hbase4.apache.org/45213] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-19 20:02:40,455 DEBUG [Listener at jenkins-hbase4.apache.org/45213] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-19 20:02:40,456 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-19 20:02:40,456 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-19 20:02:40,457 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-09-19 20:02:40,458 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-19 20:02:40,458 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695154360458 2023-09-19 20:02:40,467 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,467 INFO [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-09-19 20:02:40,467 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 20:02:40,468 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-09-19 20:02:40,468 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-09-19 20:02:40,468 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,468 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,469 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 20:02:40,469 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 20:02:40,469 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 20:02:40,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 20:02:40,469 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 20:02:40,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 20:02:40,469 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 20:02:40,469 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:40,470 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 20:02:40,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 20:02:40,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,470 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:40,470 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:40,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,470 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,470 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:40,470 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-19 20:02:40,470 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,471 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-19 20:02:40,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-19 20:02:40,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,471 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-19 20:02:40,471 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-19 20:02:40,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-19 20:02:40,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,471 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-19 20:02:40,471 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,471 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,471 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-19 20:02:40,471 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 20:02:40,471 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-19 20:02:40,471 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 20:02:40,472 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,473 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-19 20:02:40,473 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-19 20:02:40,473 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 20:02:40,472 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-19 20:02:40,476 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-19 20:02:40,476 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-19 20:02:40,476 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-19 20:02:40,473 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-19 20:02:40,476 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45123,1695153672695' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-19 20:02:40,476 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40839,1695153672784' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-19 20:02:40,476 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40397,1695153672742' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-19 20:02:40,478 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,478 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:40,478 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:40,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 20:02:40,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 20:02:40,484 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:40,484 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,485 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,485 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 20:02:40,485 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,485 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 20:02:40,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 20:02:40,485 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,485 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 20:02:40,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 20:02:40,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:40,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:40,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:40,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 20:02:40,487 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40839,1695153672784' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-19 20:02:40,487 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3d5f998f[Count = 1] remaining members to acquire global barrier 2023-09-19 20:02:40,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:40,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 20:02:40,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 20:02:40,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 20:02:40,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 20:02:40,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:40,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:40,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:40,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 20:02:40,489 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40397,1695153672742' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-19 20:02:40,489 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3d5f998f[Count = 0] remaining members to acquire global barrier 2023-09-19 20:02:40,489 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-09-19 20:02:40,489 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,493 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,493 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,493 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,493 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,493 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,493 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-19 20:02:40,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,493 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:40,493 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,494 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-19 20:02:40,494 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-19 20:02:40,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,494 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-19 20:02:40,494 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-19 20:02:40,494 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-19 20:02:40,494 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45123,1695153672695' in zk 2023-09-19 20:02:40,494 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:40,494 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-19 20:02:40,494 DEBUG [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1695153759648.678a7789310227b4ffc0582158de6097. 2023-09-19 20:02:40,494 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-19 20:02:40,494 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-19 20:02:40,494 DEBUG [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1695153759648.a43b1ec0b84074e7afda96112ccfa6cd. 2023-09-19 20:02:40,494 DEBUG [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695153759648.678a7789310227b4ffc0582158de6097. started... 2023-09-19 20:02:40,494 DEBUG [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695153759648.a43b1ec0b84074e7afda96112ccfa6cd. started... 2023-09-19 20:02:40,494 INFO [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] regionserver.HRegion(2745): Flushing a43b1ec0b84074e7afda96112ccfa6cd 1/1 column families, dataSize=266 B heapSize=832 B 2023-09-19 20:02:40,494 INFO [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 678a7789310227b4ffc0582158de6097 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-09-19 20:02:40,495 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-19 20:02:40,495 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 20:02:40,495 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-19 20:02:40,514 INFO [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230919df9f70d518e4450dbf0d8a5bb3697d6f to hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230919df9f70d518e4450dbf0d8a5bb3697d6f 2023-09-19 20:02:40,516 INFO [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230919357a01a41dda4d29af0e8bc4e6700802 to hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230919357a01a41dda4d29af0e8bc4e6700802 2023-09-19 20:02:40,522 INFO [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testEmptyExportFileSystemState/a43b1ec0b84074e7afda96112ccfa6cd/.tmp/cf/9dc87ab23e964188b1fd6e522dac3e02 2023-09-19 20:02:40,523 INFO [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testEmptyExportFileSystemState/678a7789310227b4ffc0582158de6097/.tmp/cf/332b732ef039441da62f6dab693fcc96 2023-09-19 20:02:40,527 DEBUG [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testEmptyExportFileSystemState/a43b1ec0b84074e7afda96112ccfa6cd/.tmp/cf/9dc87ab23e964188b1fd6e522dac3e02 as hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testEmptyExportFileSystemState/a43b1ec0b84074e7afda96112ccfa6cd/cf/9dc87ab23e964188b1fd6e522dac3e02 2023-09-19 20:02:40,528 DEBUG [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testEmptyExportFileSystemState/678a7789310227b4ffc0582158de6097/.tmp/cf/332b732ef039441da62f6dab693fcc96 as hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testEmptyExportFileSystemState/678a7789310227b4ffc0582158de6097/cf/332b732ef039441da62f6dab693fcc96 2023-09-19 20:02:40,532 INFO [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testEmptyExportFileSystemState/a43b1ec0b84074e7afda96112ccfa6cd/cf/9dc87ab23e964188b1fd6e522dac3e02, entries=4, sequenceid=6, filesize=5.6 K 2023-09-19 20:02:40,533 INFO [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for a43b1ec0b84074e7afda96112ccfa6cd in 39ms, sequenceid=6, compaction requested=false 2023-09-19 20:02:40,533 DEBUG [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-09-19 20:02:40,533 INFO [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testEmptyExportFileSystemState/678a7789310227b4ffc0582158de6097/cf/332b732ef039441da62f6dab693fcc96, entries=46, sequenceid=6, filesize=12.9 K 2023-09-19 20:02:40,534 DEBUG [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a43b1ec0b84074e7afda96112ccfa6cd: 2023-09-19 20:02:40,534 DEBUG [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1695153759648.a43b1ec0b84074e7afda96112ccfa6cd.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,534 INFO [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 678a7789310227b4ffc0582158de6097 in 40ms, sequenceid=6, compaction requested=false 2023-09-19 20:02:40,534 DEBUG [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-19 20:02:40,535 DEBUG [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 678a7789310227b4ffc0582158de6097: 2023-09-19 20:02:40,536 DEBUG [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testEmptyExportFileSystemState/a43b1ec0b84074e7afda96112ccfa6cd/cf/9dc87ab23e964188b1fd6e522dac3e02] hfiles 2023-09-19 20:02:40,536 DEBUG [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testEmptyExportFileSystemState/a43b1ec0b84074e7afda96112ccfa6cd/cf/9dc87ab23e964188b1fd6e522dac3e02 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,536 DEBUG [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1695153759648.678a7789310227b4ffc0582158de6097.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,537 DEBUG [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-19 20:02:40,537 DEBUG [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testEmptyExportFileSystemState/678a7789310227b4ffc0582158de6097/cf/332b732ef039441da62f6dab693fcc96] hfiles 2023-09-19 20:02:40,537 DEBUG [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testEmptyExportFileSystemState/678a7789310227b4ffc0582158de6097/cf/332b732ef039441da62f6dab693fcc96 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,553 DEBUG [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695153759648.a43b1ec0b84074e7afda96112ccfa6cd. completed. 2023-09-19 20:02:40,553 DEBUG [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1695153759648.a43b1ec0b84074e7afda96112ccfa6cd. 2023-09-19 20:02:40,553 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-19 20:02:40,553 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-19 20:02:40,553 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:40,553 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-19 20:02:40,553 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40397,1695153672742' in zk 2023-09-19 20:02:40,555 DEBUG [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695153759648.678a7789310227b4ffc0582158de6097. completed. 2023-09-19 20:02:40,555 DEBUG [rs(jenkins-hbase4.apache.org,40839,1695153672784)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1695153759648.678a7789310227b4ffc0582158de6097. 2023-09-19 20:02:40,555 DEBUG [Listener at jenkins-hbase4.apache.org/45213] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-19 20:02:40,555 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-19 20:02:40,555 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-19 20:02:40,555 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:40,555 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-19 20:02:40,555 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40839,1695153672784' in zk 2023-09-19 20:02:40,555 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:40,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:40,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 20:02:40,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 20:02:40,556 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-19 20:02:40,556 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 20:02:40,556 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-19 20:02:40,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-19 20:02:40,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 20:02:40,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-19 20:02:40,558 DEBUG [Listener at jenkins-hbase4.apache.org/45213] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-19 20:02:40,559 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:40,559 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-19 20:02:40,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 20:02:40,560 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 20:02:40,560 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-19 20:02:40,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:40,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:40,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:40,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 20:02:40,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:40,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:40,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:40,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,40397,1695153672742': 2023-09-19 20:02:40,564 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40397,1695153672742' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-19 20:02:40,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:40,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 20:02:40,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 20:02:40,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 20:02:40,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 20:02:40,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:40,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:40,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:40,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 20:02:40,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:40,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:40,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:40,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,40839,1695153672784': 2023-09-19 20:02:40,566 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40839,1695153672784' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-19 20:02:40,566 INFO [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-09-19 20:02:40,566 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-19 20:02:40,566 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-19 20:02:40,567 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,567 INFO [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-19 20:02:40,568 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,568 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,568 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 20:02:40,568 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,568 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 20:02:40,568 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,568 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,568 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 20:02:40,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 20:02:40,569 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:40,568 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,569 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 20:02:40,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 20:02:40,568 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 20:02:40,569 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 20:02:40,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 20:02:40,569 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 20:02:40,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 20:02:40,569 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:40,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 20:02:40,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,570 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:40,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 20:02:40,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:40,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:40,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:40,571 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:40,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 20:02:40,572 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:40,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,572 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:40,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:40,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:40,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:40,574 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:40,574 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,574 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 20:02:40,574 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 20:02:40,574 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 20:02:40,574 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 20:02:40,574 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 20:02:40,574 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 20:02:40,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 20:02:40,574 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 20:02:40,574 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 20:02:40,574 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:40,576 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 20:02:40,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 20:02:40,576 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 20:02:40,574 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,576 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 20:02:40,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 20:02:40,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 20:02:40,576 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-09-19 20:02:40,576 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:40,576 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 20:02:40,576 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 20:02:40,576 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,576 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-19 20:02:40,576 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 20:02:40,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 20:02:40,576 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:40,577 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,577 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:40,577 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:40,577 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,577 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,577 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230919357a01a41dda4d29af0e8bc4e6700802, hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230919df9f70d518e4450dbf0d8a5bb3697d6f] mob files 2023-09-19 20:02:40,577 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230919357a01a41dda4d29af0e8bc4e6700802 2023-09-19 20:02:40,577 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230919df9f70d518e4450dbf0d8a5bb3697d6f 2023-09-19 20:02:40,590 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,590 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,612 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,613 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-09-19 20:02:40,613 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,613 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,613 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1695153760454Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1695153760590 (+136 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1695153760590Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1695153760590Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1695153760593 (+3 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1695153760605 (+12 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1695153760613 (+8 ms) 2023-09-19 20:02:40,619 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-19 20:02:40,621 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 164 msec 2023-09-19 20:02:40,758 DEBUG [Listener at jenkins-hbase4.apache.org/45213] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-19 20:02:40,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-19 20:02:40,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-19 20:02:40,760 INFO [Listener at jenkins-hbase4.apache.org/45213] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/export-test/export-1695153760760 2023-09-19 20:02:40,760 INFO [Listener at jenkins-hbase4.apache.org/45213] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:38739, tgtDir=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/export-test/export-1695153760760, rawTgtDir=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/export-test/export-1695153760760, srcFsUri=hdfs://localhost:38739, srcDir=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf 2023-09-19 20:02:40,782 DEBUG [Listener at jenkins-hbase4.apache.org/45213] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:38739, inputRoot=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf 2023-09-19 20:02:40,782 DEBUG [Listener at jenkins-hbase4.apache.org/45213] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-51458096_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/export-test/export-1695153760760, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/export-test/export-1695153760760/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,782 INFO [Listener at jenkins-hbase4.apache.org/45213] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:38739, inputRoot=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf, snapshotDir=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-09-19 20:02:40,787 INFO [Listener at jenkins-hbase4.apache.org/45213] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/export-test/export-1695153760760/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:40,804 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-19 20:02:40,805 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-19 20:02:40,805 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-19 20:02:40,806 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-19 20:02:41,685 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59/hadoop-1845678690030502160.jar 2023-09-19 20:02:41,686 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-19 20:02:41,686 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-19 20:02:41,752 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59/hadoop-6551426677115112602.jar 2023-09-19 20:02:41,753 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-19 20:02:41,753 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-19 20:02:41,754 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-19 20:02:41,754 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-19 20:02:41,754 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-19 20:02:41,754 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-19 20:02:41,755 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-19 20:02:41,755 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-19 20:02:41,755 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-19 20:02:41,756 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-19 20:02:41,756 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-19 20:02:41,757 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-19 20:02:41,757 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-19 20:02:41,757 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-19 20:02:41,757 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-19 20:02:41,758 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-19 20:02:41,758 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-19 20:02:41,759 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-19 20:02:41,759 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-19 20:02:41,759 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-19 20:02:41,760 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-19 20:02:41,760 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-19 20:02:41,761 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-19 20:02:42,106 WARN [Listener at jenkins-hbase4.apache.org/45213] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-19 20:02:42,108 INFO [Listener at jenkins-hbase4.apache.org/45213] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-09-19 20:02:43,775 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-19 20:02:43,775 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-19 20:02:43,778 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695153679175_0005_000001 (auth:SIMPLE) 2023-09-19 20:02:44,443 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695153679175_0006_000001 (auth:SIMPLE) 2023-09-19 20:02:44,512 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-19 20:02:48,138 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695153679175_0006_000001 (auth:SIMPLE) 2023-09-19 20:02:50,444 INFO [Listener at jenkins-hbase4.apache.org/45213] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-19 20:02:50,444 INFO [Listener at jenkins-hbase4.apache.org/45213] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-19 20:02:50,449 INFO [Listener at jenkins-hbase4.apache.org/45213] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:50,449 INFO [Listener at jenkins-hbase4.apache.org/45213] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-19 20:02:50,450 INFO [Listener at jenkins-hbase4.apache.org/45213] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-19 20:02:50,450 DEBUG [Listener at jenkins-hbase4.apache.org/45213] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1909323301_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:50,450 DEBUG [Listener at jenkins-hbase4.apache.org/45213] snapshot.TestExportSnapshot(367): hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-09-19 20:02:50,450 DEBUG [Listener at jenkins-hbase4.apache.org/45213] snapshot.TestExportSnapshot(367): hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-09-19 20:02:50,451 DEBUG [Listener at jenkins-hbase4.apache.org/45213] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1909323301_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/export-test/export-1695153760760/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/export-test/export-1695153760760/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:50,451 DEBUG [Listener at jenkins-hbase4.apache.org/45213] snapshot.TestExportSnapshot(367): hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/export-test/export-1695153760760/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-09-19 20:02:50,451 DEBUG [Listener at jenkins-hbase4.apache.org/45213] snapshot.TestExportSnapshot(367): hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/export-test/export-1695153760760/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-09-19 20:02:50,455 INFO [Listener at jenkins-hbase4.apache.org/45213] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-09-19 20:02:50,456 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-09-19 20:02:50,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] procedure2.ProcedureExecutor(1028): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-19 20:02:50,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-19 20:02:50,460 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695153770459"}]},"ts":"1695153770459"} 2023-09-19 20:02:50,461 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-09-19 20:02:50,462 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-09-19 20:02:50,463 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=a43b1ec0b84074e7afda96112ccfa6cd, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=678a7789310227b4ffc0582158de6097, UNASSIGN}] 2023-09-19 20:02:50,465 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=a43b1ec0b84074e7afda96112ccfa6cd, UNASSIGN 2023-09-19 20:02:50,465 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=678a7789310227b4ffc0582158de6097, UNASSIGN 2023-09-19 20:02:50,466 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=a43b1ec0b84074e7afda96112ccfa6cd, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:50,466 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=678a7789310227b4ffc0582158de6097, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:50,466 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1695153759648.a43b1ec0b84074e7afda96112ccfa6cd.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695153770465"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695153770465"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695153770465"}]},"ts":"1695153770465"} 2023-09-19 20:02:50,466 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1695153759648.678a7789310227b4ffc0582158de6097.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695153770466"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695153770466"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695153770466"}]},"ts":"1695153770466"} 2023-09-19 20:02:50,467 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure a43b1ec0b84074e7afda96112ccfa6cd, server=jenkins-hbase4.apache.org,40397,1695153672742}] 2023-09-19 20:02:50,468 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure 678a7789310227b4ffc0582158de6097, server=jenkins-hbase4.apache.org,40839,1695153672784}] 2023-09-19 20:02:50,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-19 20:02:50,619 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close a43b1ec0b84074e7afda96112ccfa6cd 2023-09-19 20:02:50,619 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a43b1ec0b84074e7afda96112ccfa6cd, disabling compactions & flushes 2023-09-19 20:02:50,619 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1695153759648.a43b1ec0b84074e7afda96112ccfa6cd. 2023-09-19 20:02:50,619 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1695153759648.a43b1ec0b84074e7afda96112ccfa6cd. 2023-09-19 20:02:50,619 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1695153759648.a43b1ec0b84074e7afda96112ccfa6cd. after waiting 0 ms 2023-09-19 20:02:50,619 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1695153759648.a43b1ec0b84074e7afda96112ccfa6cd. 2023-09-19 20:02:50,623 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 678a7789310227b4ffc0582158de6097 2023-09-19 20:02:50,623 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 678a7789310227b4ffc0582158de6097, disabling compactions & flushes 2023-09-19 20:02:50,623 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1695153759648.678a7789310227b4ffc0582158de6097. 2023-09-19 20:02:50,623 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1695153759648.678a7789310227b4ffc0582158de6097. 2023-09-19 20:02:50,623 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1695153759648.678a7789310227b4ffc0582158de6097. after waiting 0 ms 2023-09-19 20:02:50,623 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1695153759648.678a7789310227b4ffc0582158de6097. 2023-09-19 20:02:50,628 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testEmptyExportFileSystemState/a43b1ec0b84074e7afda96112ccfa6cd/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-19 20:02:50,628 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testEmptyExportFileSystemState/678a7789310227b4ffc0582158de6097/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-19 20:02:50,628 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-19 20:02:50,629 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1695153759648.a43b1ec0b84074e7afda96112ccfa6cd. 2023-09-19 20:02:50,629 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a43b1ec0b84074e7afda96112ccfa6cd: 2023-09-19 20:02:50,630 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-19 20:02:50,630 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1695153759648.678a7789310227b4ffc0582158de6097. 2023-09-19 20:02:50,631 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 678a7789310227b4ffc0582158de6097: 2023-09-19 20:02:50,632 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed a43b1ec0b84074e7afda96112ccfa6cd 2023-09-19 20:02:50,632 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=a43b1ec0b84074e7afda96112ccfa6cd, regionState=CLOSED 2023-09-19 20:02:50,632 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1695153759648.a43b1ec0b84074e7afda96112ccfa6cd.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695153770632"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695153770632"}]},"ts":"1695153770632"} 2023-09-19 20:02:50,632 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 678a7789310227b4ffc0582158de6097 2023-09-19 20:02:50,633 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=678a7789310227b4ffc0582158de6097, regionState=CLOSED 2023-09-19 20:02:50,633 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1695153759648.678a7789310227b4ffc0582158de6097.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695153770633"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695153770633"}]},"ts":"1695153770633"} 2023-09-19 20:02:50,635 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=102, resume processing ppid=100 2023-09-19 20:02:50,635 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure a43b1ec0b84074e7afda96112ccfa6cd, server=jenkins-hbase4.apache.org,40397,1695153672742 in 166 msec 2023-09-19 20:02:50,636 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=103, resume processing ppid=101 2023-09-19 20:02:50,636 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure 678a7789310227b4ffc0582158de6097, server=jenkins-hbase4.apache.org,40839,1695153672784 in 166 msec 2023-09-19 20:02:50,636 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=a43b1ec0b84074e7afda96112ccfa6cd, UNASSIGN in 172 msec 2023-09-19 20:02:50,637 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=101, resume processing ppid=99 2023-09-19 20:02:50,637 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=678a7789310227b4ffc0582158de6097, UNASSIGN in 173 msec 2023-09-19 20:02:50,638 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695153770638"}]},"ts":"1695153770638"} 2023-09-19 20:02:50,639 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-09-19 20:02:50,641 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-09-19 20:02:50,642 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 185 msec 2023-09-19 20:02:50,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-19 20:02:50,762 INFO [Listener at jenkins-hbase4.apache.org/45213] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-09-19 20:02:50,762 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-09-19 20:02:50,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] procedure2.ProcedureExecutor(1028): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-19 20:02:50,765 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-19 20:02:50,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-09-19 20:02:50,766 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-19 20:02:50,768 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40839] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-09-19 20:02:50,770 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testEmptyExportFileSystemState/a43b1ec0b84074e7afda96112ccfa6cd 2023-09-19 20:02:50,770 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testEmptyExportFileSystemState/678a7789310227b4ffc0582158de6097 2023-09-19 20:02:50,771 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-19 20:02:50,771 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-19 20:02:50,771 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-19 20:02:50,771 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-19 20:02:50,771 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-19 20:02:50,771 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-19 20:02:50,772 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-19 20:02:50,772 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-19 20:02:50,772 DEBUG [HFileArchiver-18] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testEmptyExportFileSystemState/a43b1ec0b84074e7afda96112ccfa6cd/cf, FileablePath, hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testEmptyExportFileSystemState/a43b1ec0b84074e7afda96112ccfa6cd/recovered.edits] 2023-09-19 20:02:50,772 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testEmptyExportFileSystemState/678a7789310227b4ffc0582158de6097/cf, FileablePath, hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testEmptyExportFileSystemState/678a7789310227b4ffc0582158de6097/recovered.edits] 2023-09-19 20:02:50,773 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-19 20:02:50,773 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-19 20:02:50,773 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-19 20:02:50,773 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-19 20:02:50,773 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 20:02:50,773 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 20:02:50,773 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 20:02:50,773 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 20:02:50,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-09-19 20:02:50,776 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testEmptyExportFileSystemState/a43b1ec0b84074e7afda96112ccfa6cd/cf/9dc87ab23e964188b1fd6e522dac3e02 to hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/archive/data/default/testtb-testEmptyExportFileSystemState/a43b1ec0b84074e7afda96112ccfa6cd/cf/9dc87ab23e964188b1fd6e522dac3e02 2023-09-19 20:02:50,776 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testEmptyExportFileSystemState/678a7789310227b4ffc0582158de6097/cf/332b732ef039441da62f6dab693fcc96 to hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/archive/data/default/testtb-testEmptyExportFileSystemState/678a7789310227b4ffc0582158de6097/cf/332b732ef039441da62f6dab693fcc96 2023-09-19 20:02:50,779 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testEmptyExportFileSystemState/a43b1ec0b84074e7afda96112ccfa6cd/recovered.edits/9.seqid to hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/archive/data/default/testtb-testEmptyExportFileSystemState/a43b1ec0b84074e7afda96112ccfa6cd/recovered.edits/9.seqid 2023-09-19 20:02:50,779 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testEmptyExportFileSystemState/678a7789310227b4ffc0582158de6097/recovered.edits/9.seqid to hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/archive/data/default/testtb-testEmptyExportFileSystemState/678a7789310227b4ffc0582158de6097/recovered.edits/9.seqid 2023-09-19 20:02:50,779 DEBUG [HFileArchiver-18] backup.HFileArchiver(596): Deleted hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testEmptyExportFileSystemState/a43b1ec0b84074e7afda96112ccfa6cd 2023-09-19 20:02:50,780 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testEmptyExportFileSystemState/678a7789310227b4ffc0582158de6097 2023-09-19 20:02:50,780 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-09-19 20:02:50,780 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-09-19 20:02:50,781 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-09-19 20:02:50,784 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230919357a01a41dda4d29af0e8bc4e6700802 to hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230919357a01a41dda4d29af0e8bc4e6700802 2023-09-19 20:02:50,785 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230919df9f70d518e4450dbf0d8a5bb3697d6f to hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230919df9f70d518e4450dbf0d8a5bb3697d6f 2023-09-19 20:02:50,785 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-09-19 20:02:50,787 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-19 20:02:50,789 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-09-19 20:02:50,790 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-09-19 20:02:50,791 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-19 20:02:50,791 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-09-19 20:02:50,791 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1695153759648.a43b1ec0b84074e7afda96112ccfa6cd.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695153770791"}]},"ts":"9223372036854775807"} 2023-09-19 20:02:50,792 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1695153759648.678a7789310227b4ffc0582158de6097.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695153770791"}]},"ts":"9223372036854775807"} 2023-09-19 20:02:50,793 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-19 20:02:50,793 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => a43b1ec0b84074e7afda96112ccfa6cd, NAME => 'testtb-testEmptyExportFileSystemState,,1695153759648.a43b1ec0b84074e7afda96112ccfa6cd.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 678a7789310227b4ffc0582158de6097, NAME => 'testtb-testEmptyExportFileSystemState,1,1695153759648.678a7789310227b4ffc0582158de6097.', STARTKEY => '1', ENDKEY => ''}] 2023-09-19 20:02:50,793 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-09-19 20:02:50,793 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695153770793"}]},"ts":"9223372036854775807"} 2023-09-19 20:02:50,795 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-09-19 20:02:50,796 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-19 20:02:50,797 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 33 msec 2023-09-19 20:02:50,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-09-19 20:02:50,875 INFO [Listener at jenkins-hbase4.apache.org/45213] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-09-19 20:02:50,882 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-09-19 20:02:50,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:50,886 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-09-19 20:02:50,888 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-09-19 20:02:50,911 INFO [Listener at jenkins-hbase4.apache.org/45213] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=766 (was 762) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x51b5961f-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x51b5961f-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-51458096_17 at /127.0.0.1:36158 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4725 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x51b5961f-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1781244183) connection to jenkins-hbase4.apache.org/172.31.14.131:45143 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1781244183) connection to jenkins-hbase4.apache.org/172.31.14.131:42765 from appattempt_1695153679175_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1909323301_17 at /127.0.0.1:35692 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_616210125_1 at /127.0.0.1:44324 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1781244183) connection to jenkins-hbase4.apache.org/172.31.14.131:39423 from appattempt_1695153679175_0005_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1909323301_17 at /127.0.0.1:44346 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x51b5961f-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=929 (was 916) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=231 (was 212) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=7437 (was 7539) 2023-09-19 20:02:50,911 WARN [Listener at jenkins-hbase4.apache.org/45213] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-09-19 20:02:50,930 INFO [Listener at jenkins-hbase4.apache.org/45213] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=766, OpenFileDescriptor=929, MaxFileDescriptor=60000, SystemLoadAverage=231, ProcessCount=168, AvailableMemoryMB=7436 2023-09-19 20:02:50,930 WARN [Listener at jenkins-hbase4.apache.org/45213] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-09-19 20:02:50,932 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-19 20:02:50,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] procedure2.ProcedureExecutor(1028): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:50,935 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-09-19 20:02:50,935 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-09-19 20:02:50,935 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-19 20:02:50,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-19 20:02:50,937 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6a0d693a9122f7d826fbbc146dbae1a1 2023-09-19 20:02:50,937 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d5e34b770e2f4bb083a4cdc26515fc19 2023-09-19 20:02:50,938 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6a0d693a9122f7d826fbbc146dbae1a1 empty. 2023-09-19 20:02:50,938 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d5e34b770e2f4bb083a4cdc26515fc19 empty. 2023-09-19 20:02:50,938 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6a0d693a9122f7d826fbbc146dbae1a1 2023-09-19 20:02:50,938 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d5e34b770e2f4bb083a4cdc26515fc19 2023-09-19 20:02:50,938 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-09-19 20:02:50,948 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-09-19 20:02:50,950 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => d5e34b770e2f4bb083a4cdc26515fc19, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1695153770931.d5e34b770e2f4bb083a4cdc26515fc19.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp 2023-09-19 20:02:50,950 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 6a0d693a9122f7d826fbbc146dbae1a1, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1695153770931.6a0d693a9122f7d826fbbc146dbae1a1.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp 2023-09-19 20:02:50,967 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1695153770931.6a0d693a9122f7d826fbbc146dbae1a1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 20:02:50,967 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 6a0d693a9122f7d826fbbc146dbae1a1, disabling compactions & flushes 2023-09-19 20:02:50,967 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1695153770931.6a0d693a9122f7d826fbbc146dbae1a1. 2023-09-19 20:02:50,967 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695153770931.6a0d693a9122f7d826fbbc146dbae1a1. 2023-09-19 20:02:50,967 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695153770931.6a0d693a9122f7d826fbbc146dbae1a1. after waiting 0 ms 2023-09-19 20:02:50,967 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1695153770931.6a0d693a9122f7d826fbbc146dbae1a1. 2023-09-19 20:02:50,967 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1695153770931.6a0d693a9122f7d826fbbc146dbae1a1. 2023-09-19 20:02:50,967 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 6a0d693a9122f7d826fbbc146dbae1a1: 2023-09-19 20:02:50,967 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1695153770931.d5e34b770e2f4bb083a4cdc26515fc19.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 20:02:50,967 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing d5e34b770e2f4bb083a4cdc26515fc19, disabling compactions & flushes 2023-09-19 20:02:50,967 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1695153770931.d5e34b770e2f4bb083a4cdc26515fc19. 2023-09-19 20:02:50,967 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695153770931.d5e34b770e2f4bb083a4cdc26515fc19. 2023-09-19 20:02:50,967 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695153770931.d5e34b770e2f4bb083a4cdc26515fc19. after waiting 0 ms 2023-09-19 20:02:50,968 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1695153770931.d5e34b770e2f4bb083a4cdc26515fc19. 2023-09-19 20:02:50,968 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1695153770931.d5e34b770e2f4bb083a4cdc26515fc19. 2023-09-19 20:02:50,968 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for d5e34b770e2f4bb083a4cdc26515fc19: 2023-09-19 20:02:50,970 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-09-19 20:02:50,971 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695153770931.6a0d693a9122f7d826fbbc146dbae1a1.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695153770971"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695153770971"}]},"ts":"1695153770971"} 2023-09-19 20:02:50,971 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695153770931.d5e34b770e2f4bb083a4cdc26515fc19.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695153770971"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695153770971"}]},"ts":"1695153770971"} 2023-09-19 20:02:50,973 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-19 20:02:50,973 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-19 20:02:50,974 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695153770973"}]},"ts":"1695153770973"} 2023-09-19 20:02:50,974 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-09-19 20:02:50,978 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-19 20:02:50,979 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-19 20:02:50,979 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-19 20:02:50,979 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-19 20:02:50,979 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-19 20:02:50,979 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6a0d693a9122f7d826fbbc146dbae1a1, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d5e34b770e2f4bb083a4cdc26515fc19, ASSIGN}] 2023-09-19 20:02:50,982 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d5e34b770e2f4bb083a4cdc26515fc19, ASSIGN 2023-09-19 20:02:50,982 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6a0d693a9122f7d826fbbc146dbae1a1, ASSIGN 2023-09-19 20:02:50,982 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d5e34b770e2f4bb083a4cdc26515fc19, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40397,1695153672742; forceNewPlan=false, retain=false 2023-09-19 20:02:50,982 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6a0d693a9122f7d826fbbc146dbae1a1, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45123,1695153672695; forceNewPlan=false, retain=false 2023-09-19 20:02:51,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-19 20:02:51,132 INFO [jenkins-hbase4:37929] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-19 20:02:51,135 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=6a0d693a9122f7d826fbbc146dbae1a1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:51,135 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=d5e34b770e2f4bb083a4cdc26515fc19, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:51,135 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695153770931.6a0d693a9122f7d826fbbc146dbae1a1.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695153771135"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695153771135"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695153771135"}]},"ts":"1695153771135"} 2023-09-19 20:02:51,135 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695153770931.d5e34b770e2f4bb083a4cdc26515fc19.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695153771135"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695153771135"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695153771135"}]},"ts":"1695153771135"} 2023-09-19 20:02:51,137 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=108, ppid=106, state=RUNNABLE; OpenRegionProcedure 6a0d693a9122f7d826fbbc146dbae1a1, server=jenkins-hbase4.apache.org,45123,1695153672695}] 2023-09-19 20:02:51,137 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure d5e34b770e2f4bb083a4cdc26515fc19, server=jenkins-hbase4.apache.org,40397,1695153672742}] 2023-09-19 20:02:51,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-19 20:02:51,293 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1695153770931.d5e34b770e2f4bb083a4cdc26515fc19. 2023-09-19 20:02:51,293 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1695153770931.6a0d693a9122f7d826fbbc146dbae1a1. 2023-09-19 20:02:51,293 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d5e34b770e2f4bb083a4cdc26515fc19, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1695153770931.d5e34b770e2f4bb083a4cdc26515fc19.', STARTKEY => '1', ENDKEY => ''} 2023-09-19 20:02:51,293 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6a0d693a9122f7d826fbbc146dbae1a1, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1695153770931.6a0d693a9122f7d826fbbc146dbae1a1.', STARTKEY => '', ENDKEY => '1'} 2023-09-19 20:02:51,293 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1695153770931.6a0d693a9122f7d826fbbc146dbae1a1. service=AccessControlService 2023-09-19 20:02:51,293 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1695153770931.d5e34b770e2f4bb083a4cdc26515fc19. service=AccessControlService 2023-09-19 20:02:51,294 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-19 20:02:51,294 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-19 20:02:51,294 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 6a0d693a9122f7d826fbbc146dbae1a1 2023-09-19 20:02:51,294 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp d5e34b770e2f4bb083a4cdc26515fc19 2023-09-19 20:02:51,294 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1695153770931.6a0d693a9122f7d826fbbc146dbae1a1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 20:02:51,294 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1695153770931.d5e34b770e2f4bb083a4cdc26515fc19.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 20:02:51,294 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6a0d693a9122f7d826fbbc146dbae1a1 2023-09-19 20:02:51,294 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d5e34b770e2f4bb083a4cdc26515fc19 2023-09-19 20:02:51,294 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6a0d693a9122f7d826fbbc146dbae1a1 2023-09-19 20:02:51,294 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d5e34b770e2f4bb083a4cdc26515fc19 2023-09-19 20:02:51,295 INFO [StoreOpener-d5e34b770e2f4bb083a4cdc26515fc19-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region d5e34b770e2f4bb083a4cdc26515fc19 2023-09-19 20:02:51,295 INFO [StoreOpener-6a0d693a9122f7d826fbbc146dbae1a1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 6a0d693a9122f7d826fbbc146dbae1a1 2023-09-19 20:02:51,296 DEBUG [StoreOpener-d5e34b770e2f4bb083a4cdc26515fc19-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemStateWithSkipTmp/d5e34b770e2f4bb083a4cdc26515fc19/cf 2023-09-19 20:02:51,296 DEBUG [StoreOpener-6a0d693a9122f7d826fbbc146dbae1a1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemStateWithSkipTmp/6a0d693a9122f7d826fbbc146dbae1a1/cf 2023-09-19 20:02:51,296 DEBUG [StoreOpener-d5e34b770e2f4bb083a4cdc26515fc19-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemStateWithSkipTmp/d5e34b770e2f4bb083a4cdc26515fc19/cf 2023-09-19 20:02:51,296 DEBUG [StoreOpener-6a0d693a9122f7d826fbbc146dbae1a1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemStateWithSkipTmp/6a0d693a9122f7d826fbbc146dbae1a1/cf 2023-09-19 20:02:51,297 INFO [StoreOpener-d5e34b770e2f4bb083a4cdc26515fc19-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d5e34b770e2f4bb083a4cdc26515fc19 columnFamilyName cf 2023-09-19 20:02:51,297 INFO [StoreOpener-6a0d693a9122f7d826fbbc146dbae1a1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6a0d693a9122f7d826fbbc146dbae1a1 columnFamilyName cf 2023-09-19 20:02:51,298 INFO [StoreOpener-6a0d693a9122f7d826fbbc146dbae1a1-1] regionserver.HStore(310): Store=6a0d693a9122f7d826fbbc146dbae1a1/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-19 20:02:51,298 INFO [StoreOpener-d5e34b770e2f4bb083a4cdc26515fc19-1] regionserver.HStore(310): Store=d5e34b770e2f4bb083a4cdc26515fc19/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-19 20:02:51,299 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemStateWithSkipTmp/6a0d693a9122f7d826fbbc146dbae1a1 2023-09-19 20:02:51,299 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemStateWithSkipTmp/d5e34b770e2f4bb083a4cdc26515fc19 2023-09-19 20:02:51,299 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemStateWithSkipTmp/6a0d693a9122f7d826fbbc146dbae1a1 2023-09-19 20:02:51,299 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemStateWithSkipTmp/d5e34b770e2f4bb083a4cdc26515fc19 2023-09-19 20:02:51,302 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6a0d693a9122f7d826fbbc146dbae1a1 2023-09-19 20:02:51,302 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d5e34b770e2f4bb083a4cdc26515fc19 2023-09-19 20:02:51,303 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemStateWithSkipTmp/d5e34b770e2f4bb083a4cdc26515fc19/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-19 20:02:51,303 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemStateWithSkipTmp/6a0d693a9122f7d826fbbc146dbae1a1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-19 20:02:51,305 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d5e34b770e2f4bb083a4cdc26515fc19; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65793263, jitterRate=-0.01960398256778717}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-19 20:02:51,305 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d5e34b770e2f4bb083a4cdc26515fc19: 2023-09-19 20:02:51,305 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6a0d693a9122f7d826fbbc146dbae1a1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64652992, jitterRate=-0.03659534454345703}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-19 20:02:51,305 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6a0d693a9122f7d826fbbc146dbae1a1: 2023-09-19 20:02:51,305 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1695153770931.6a0d693a9122f7d826fbbc146dbae1a1., pid=108, masterSystemTime=1695153771289 2023-09-19 20:02:51,305 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1695153770931.d5e34b770e2f4bb083a4cdc26515fc19., pid=109, masterSystemTime=1695153771289 2023-09-19 20:02:51,307 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1695153770931.6a0d693a9122f7d826fbbc146dbae1a1. 2023-09-19 20:02:51,307 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1695153770931.6a0d693a9122f7d826fbbc146dbae1a1. 2023-09-19 20:02:51,307 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=6a0d693a9122f7d826fbbc146dbae1a1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:51,307 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1695153770931.d5e34b770e2f4bb083a4cdc26515fc19. 2023-09-19 20:02:51,307 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1695153770931.d5e34b770e2f4bb083a4cdc26515fc19. 2023-09-19 20:02:51,307 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695153770931.6a0d693a9122f7d826fbbc146dbae1a1.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695153771307"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695153771307"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695153771307"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695153771307"}]},"ts":"1695153771307"} 2023-09-19 20:02:51,308 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=d5e34b770e2f4bb083a4cdc26515fc19, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:51,308 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695153770931.d5e34b770e2f4bb083a4cdc26515fc19.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695153771307"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695153771307"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695153771307"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695153771307"}]},"ts":"1695153771307"} 2023-09-19 20:02:51,310 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=108, resume processing ppid=106 2023-09-19 20:02:51,310 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=108, ppid=106, state=SUCCESS; OpenRegionProcedure 6a0d693a9122f7d826fbbc146dbae1a1, server=jenkins-hbase4.apache.org,45123,1695153672695 in 171 msec 2023-09-19 20:02:51,311 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=109, resume processing ppid=107 2023-09-19 20:02:51,311 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure d5e34b770e2f4bb083a4cdc26515fc19, server=jenkins-hbase4.apache.org,40397,1695153672742 in 172 msec 2023-09-19 20:02:51,311 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6a0d693a9122f7d826fbbc146dbae1a1, ASSIGN in 331 msec 2023-09-19 20:02:51,312 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=107, resume processing ppid=105 2023-09-19 20:02:51,312 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d5e34b770e2f4bb083a4cdc26515fc19, ASSIGN in 332 msec 2023-09-19 20:02:51,313 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-19 20:02:51,313 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695153771313"}]},"ts":"1695153771313"} 2023-09-19 20:02:51,314 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-09-19 20:02:51,316 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-09-19 20:02:51,316 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-09-19 20:02:51,317 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40839] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-19 20:02:51,319 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 20:02:51,319 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 20:02:51,319 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 20:02:51,319 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 20:02:51,320 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-19 20:02:51,320 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-19 20:02:51,320 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-19 20:02:51,320 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-19 20:02:51,321 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 388 msec 2023-09-19 20:02:51,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-19 20:02:51,539 INFO [Listener at jenkins-hbase4.apache.org/45213] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-09-19 20:02:51,541 DEBUG [Listener at jenkins-hbase4.apache.org/45213] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,541 DEBUG [Listener at jenkins-hbase4.apache.org/45213] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1695153770931.6a0d693a9122f7d826fbbc146dbae1a1. 2023-09-19 20:02:51,544 INFO [Listener at jenkins-hbase4.apache.org/45213] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-19 20:02:51,554 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-19 20:02:51,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695153771555 (current time:1695153771555). 2023-09-19 20:02:51,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-19 20:02:51,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] zookeeper.ReadOnlyZKClient(139): Connect 0x09fac63f to 127.0.0.1:60323 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-19 20:02:51,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6ef33e7f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-19 20:02:51,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 20:02:51,567 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54330, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 20:02:51,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x09fac63f to 127.0.0.1:60323 2023-09-19 20:02:51,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 20:02:51,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] zookeeper.ReadOnlyZKClient(139): Connect 0x7e95ddc0 to 127.0.0.1:60323 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-19 20:02:51,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@21813713, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-19 20:02:51,574 DEBUG [hconnection-0x56f6f59a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 20:02:51,576 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54332, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 20:02:51,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 20:02:51,582 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41344, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 20:02:51,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7e95ddc0 to 127.0.0.1:60323 2023-09-19 20:02:51,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 20:02:51,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-19 20:02:51,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-19 20:02:51,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-19 20:02:51,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] procedure2.ProcedureExecutor(1028): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-19 20:02:51,586 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-19 20:02:51,587 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1695154371587 2023-09-19 20:02:51,587 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-19 20:02:51,588 DEBUG [Listener at jenkins-hbase4.apache.org/45213] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-19 20:02:51,588 DEBUG [Listener at jenkins-hbase4.apache.org/45213] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-19 20:02:51,589 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-19 20:02:51,589 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-19 20:02:51,590 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 4 msec 2023-09-19 20:02:51,591 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-19 20:02:51,591 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1695154371591 2023-09-19 20:02:51,601 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,601 INFO [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-09-19 20:02:51,601 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 20:02:51,602 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-09-19 20:02:51,602 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-09-19 20:02:51,602 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,602 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,604 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 20:02:51,604 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:51,604 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 20:02:51,604 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 20:02:51,604 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 20:02:51,604 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 20:02:51,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 20:02:51,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 20:02:51,605 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:51,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 20:02:51,605 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:51,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 20:02:51,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,605 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:51,605 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-19 20:02:51,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,605 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,605 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,606 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-19 20:02:51,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-19 20:02:51,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-19 20:02:51,606 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-19 20:02:51,606 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-19 20:02:51,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,606 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,606 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,606 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-19 20:02:51,606 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-19 20:02:51,606 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 20:02:51,606 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-19 20:02:51,607 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-19 20:02:51,607 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-19 20:02:51,606 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 20:02:51,607 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,607 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40839,1695153672784' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-19 20:02:51,608 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-19 20:02:51,608 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 20:02:51,608 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-19 20:02:51,609 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-19 20:02:51,609 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-19 20:02:51,609 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40397,1695153672742' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-19 20:02:51,609 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-19 20:02:51,609 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45123,1695153672695' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-19 20:02:51,615 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,615 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,616 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:51,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:51,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 20:02:51,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 20:02:51,616 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:51,616 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 20:02:51,616 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,616 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 20:02:51,616 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,616 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 20:02:51,616 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 20:02:51,616 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 20:02:51,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:51,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:51,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:51,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 20:02:51,618 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40397,1695153672742' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-19 20:02:51,618 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@648667fc[Count = 1] remaining members to acquire global barrier 2023-09-19 20:02:51,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:51,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 20:02:51,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 20:02:51,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 20:02:51,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 20:02:51,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:51,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:51,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:51,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 20:02:51,620 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45123,1695153672695' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-19 20:02:51,620 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@648667fc[Count = 0] remaining members to acquire global barrier 2023-09-19 20:02:51,620 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-09-19 20:02:51,620 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,621 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,621 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,621 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,621 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,621 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,621 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,621 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-19 20:02:51,621 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-19 20:02:51,621 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-19 20:02:51,621 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:51,621 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-19 20:02:51,621 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-19 20:02:51,621 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,40839,1695153672784' in zk 2023-09-19 20:02:51,621 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-19 20:02:51,621 DEBUG [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695153770931.d5e34b770e2f4bb083a4cdc26515fc19. 2023-09-19 20:02:51,621 DEBUG [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695153770931.d5e34b770e2f4bb083a4cdc26515fc19. started... 2023-09-19 20:02:51,621 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-19 20:02:51,621 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-19 20:02:51,621 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:51,622 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-19 20:02:51,622 DEBUG [rs(jenkins-hbase4.apache.org,45123,1695153672695)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695153770931.6a0d693a9122f7d826fbbc146dbae1a1. 2023-09-19 20:02:51,623 DEBUG [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d5e34b770e2f4bb083a4cdc26515fc19: 2023-09-19 20:02:51,623 DEBUG [rs(jenkins-hbase4.apache.org,45123,1695153672695)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695153770931.6a0d693a9122f7d826fbbc146dbae1a1. started... 2023-09-19 20:02:51,623 DEBUG [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1695153770931.d5e34b770e2f4bb083a4cdc26515fc19.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,623 DEBUG [rs(jenkins-hbase4.apache.org,45123,1695153672695)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6a0d693a9122f7d826fbbc146dbae1a1: 2023-09-19 20:02:51,623 DEBUG [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-19 20:02:51,623 DEBUG [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-19 20:02:51,623 DEBUG [rs(jenkins-hbase4.apache.org,45123,1695153672695)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1695153770931.6a0d693a9122f7d826fbbc146dbae1a1.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,623 DEBUG [rs(jenkins-hbase4.apache.org,45123,1695153672695)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-19 20:02:51,623 DEBUG [rs(jenkins-hbase4.apache.org,45123,1695153672695)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-19 20:02:51,625 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-19 20:02:51,625 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 20:02:51,625 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-19 20:02:51,633 DEBUG [rs(jenkins-hbase4.apache.org,45123,1695153672695)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695153770931.6a0d693a9122f7d826fbbc146dbae1a1. completed. 2023-09-19 20:02:51,633 DEBUG [rs(jenkins-hbase4.apache.org,45123,1695153672695)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695153770931.6a0d693a9122f7d826fbbc146dbae1a1. 2023-09-19 20:02:51,633 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-19 20:02:51,633 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-19 20:02:51,633 DEBUG [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695153770931.d5e34b770e2f4bb083a4cdc26515fc19. completed. 2023-09-19 20:02:51,634 DEBUG [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695153770931.d5e34b770e2f4bb083a4cdc26515fc19. 2023-09-19 20:02:51,634 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:51,634 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-19 20:02:51,634 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-19 20:02:51,634 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:51,634 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-19 20:02:51,634 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,45123,1695153672695' in zk 2023-09-19 20:02:51,634 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-19 20:02:51,634 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,40397,1695153672742' in zk 2023-09-19 20:02:51,636 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-19 20:02:51,636 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:51,636 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 20:02:51,636 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-19 20:02:51,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:51,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 20:02:51,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 20:02:51,639 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-19 20:02:51,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 20:02:51,639 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:51,639 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 20:02:51,639 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-19 20:02:51,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 20:02:51,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:51,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:51,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:51,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 20:02:51,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:51,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:51,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:51,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,40397,1695153672742': 2023-09-19 20:02:51,643 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40397,1695153672742' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-09-19 20:02:51,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:51,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 20:02:51,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 20:02:51,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 20:02:51,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 20:02:51,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:51,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:51,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:51,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 20:02:51,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:51,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:51,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:51,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,45123,1695153672695': 2023-09-19 20:02:51,647 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45123,1695153672695' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-09-19 20:02:51,647 INFO [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-09-19 20:02:51,647 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-19 20:02:51,647 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-19 20:02:51,647 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,647 INFO [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-19 20:02:51,649 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,649 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,649 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,649 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,649 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,649 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,649 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,649 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 20:02:51,649 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 20:02:51,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 20:02:51,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 20:02:51,649 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 20:02:51,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,650 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:51,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 20:02:51,650 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 20:02:51,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 20:02:51,650 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 20:02:51,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 20:02:51,650 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 20:02:51,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 20:02:51,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,651 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:51,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 20:02:51,651 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:51,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:51,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:51,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:51,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 20:02:51,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,653 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:51,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:51,654 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:51,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:51,654 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:51,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:51,657 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:51,657 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,657 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 20:02:51,657 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 20:02:51,657 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 20:02:51,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 20:02:51,658 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 20:02:51,658 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 20:02:51,657 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 20:02:51,657 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:51,657 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 20:02:51,659 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:51,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 20:02:51,658 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 20:02:51,660 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 20:02:51,660 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 20:02:51,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 20:02:51,659 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,659 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 20:02:51,660 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:51,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 20:02:51,660 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-19 20:02:51,660 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,660 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:51,660 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:51,660 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,660 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,661 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-19 20:02:51,661 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 20:02:51,661 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 20:02:51,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 20:02:51,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 20:02:51,673 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,673 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,688 DEBUG [Listener at jenkins-hbase4.apache.org/45213] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-19 20:02:51,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-19 20:02:51,689 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-09-19 20:02:51,689 DEBUG [Listener at jenkins-hbase4.apache.org/45213] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-19 20:02:51,690 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-09-19 20:02:51,690 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,690 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,690 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1695153771587Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1695153771673 (+86 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695153771673Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695153771673Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695153771676 (+3 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695153771684 (+8 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1695153771690 (+6 ms) 2023-09-19 20:02:51,693 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-19 20:02:51,694 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 105 msec 2023-09-19 20:02:51,890 DEBUG [Listener at jenkins-hbase4.apache.org/45213] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-19 20:02:51,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-19 20:02:51,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-19 20:02:51,893 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45123] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1695153770931.6a0d693a9122f7d826fbbc146dbae1a1. with WAL disabled. Data may be lost in the event of a crash. 2023-09-19 20:02:51,893 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40397] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1695153770931.d5e34b770e2f4bb083a4cdc26515fc19. with WAL disabled. Data may be lost in the event of a crash. 2023-09-19 20:02:51,896 DEBUG [Listener at jenkins-hbase4.apache.org/45213] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,896 DEBUG [Listener at jenkins-hbase4.apache.org/45213] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1695153770931.6a0d693a9122f7d826fbbc146dbae1a1. 2023-09-19 20:02:51,896 INFO [Listener at jenkins-hbase4.apache.org/45213] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-19 20:02:51,905 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-19 20:02:51,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695153771905 (current time:1695153771905). 2023-09-19 20:02:51,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-19 20:02:51,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] zookeeper.ReadOnlyZKClient(139): Connect 0x1900655e to 127.0.0.1:60323 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-19 20:02:51,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@78bb19c1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-19 20:02:51,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 20:02:51,913 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54338, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 20:02:51,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1900655e to 127.0.0.1:60323 2023-09-19 20:02:51,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 20:02:51,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] zookeeper.ReadOnlyZKClient(139): Connect 0x75cc0fef to 127.0.0.1:60323 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-19 20:02:51,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6ffcae9d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-19 20:02:51,921 DEBUG [hconnection-0x4fa9d7b2-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 20:02:51,928 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54342, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 20:02:51,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 20:02:51,932 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41360, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 20:02:51,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x75cc0fef to 127.0.0.1:60323 2023-09-19 20:02:51,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 20:02:51,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-19 20:02:51,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-19 20:02:51,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-19 20:02:51,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] procedure2.ProcedureExecutor(1028): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-19 20:02:51,937 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-19 20:02:51,937 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1695154371937 2023-09-19 20:02:51,937 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-19 20:02:51,939 DEBUG [Listener at jenkins-hbase4.apache.org/45213] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-19 20:02:51,939 DEBUG [Listener at jenkins-hbase4.apache.org/45213] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-19 20:02:51,940 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-19 20:02:51,940 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-19 20:02:51,940 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 5 msec 2023-09-19 20:02:51,941 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-19 20:02:51,942 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1695154371942 2023-09-19 20:02:51,952 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,952 INFO [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-09-19 20:02:51,953 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 20:02:51,954 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-09-19 20:02:51,954 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-09-19 20:02:51,954 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,954 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,955 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:51,955 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 20:02:51,955 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 20:02:51,955 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 20:02:51,956 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 20:02:51,956 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 20:02:51,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 20:02:51,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 20:02:51,956 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:51,956 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:51,956 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 20:02:51,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 20:02:51,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,956 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:51,956 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-19 20:02:51,956 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,957 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,957 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-19 20:02:51,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-19 20:02:51,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-19 20:02:51,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,957 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-19 20:02:51,957 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-19 20:02:51,957 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-19 20:02:51,957 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,957 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,957 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,957 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-19 20:02:51,957 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-19 20:02:51,958 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 20:02:51,957 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-19 20:02:51,959 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-19 20:02:51,959 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-19 20:02:51,959 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 20:02:51,958 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 20:02:51,960 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-19 20:02:51,960 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-19 20:02:51,960 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-19 20:02:51,960 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-19 20:02:51,959 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40397,1695153672742' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-19 20:02:51,960 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45123,1695153672695' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-19 20:02:51,960 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40839,1695153672784' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-19 20:02:51,962 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,962 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,962 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:51,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:51,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 20:02:51,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 20:02:51,963 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,963 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,963 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:51,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 20:02:51,963 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 20:02:51,963 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,963 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 20:02:51,963 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,963 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 20:02:51,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 20:02:51,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:51,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:51,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:51,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 20:02:51,964 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40397,1695153672742' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-19 20:02:51,964 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@70f4a970[Count = 1] remaining members to acquire global barrier 2023-09-19 20:02:51,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:51,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 20:02:51,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 20:02:51,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 20:02:51,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 20:02:51,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:51,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:51,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:51,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 20:02:51,966 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45123,1695153672695' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-19 20:02:51,966 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@70f4a970[Count = 0] remaining members to acquire global barrier 2023-09-19 20:02:51,966 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-09-19 20:02:51,967 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,977 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,977 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,977 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,977 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,977 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-19 20:02:51,977 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,977 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-19 20:02:51,977 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:51,977 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,977 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,40839,1695153672784' in zk 2023-09-19 20:02:51,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:51,977 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-19 20:02:51,977 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-19 20:02:51,977 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:51,977 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-19 20:02:51,977 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-19 20:02:51,977 DEBUG [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695153770931.d5e34b770e2f4bb083a4cdc26515fc19. 2023-09-19 20:02:51,977 DEBUG [rs(jenkins-hbase4.apache.org,45123,1695153672695)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695153770931.6a0d693a9122f7d826fbbc146dbae1a1. 2023-09-19 20:02:51,978 DEBUG [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695153770931.d5e34b770e2f4bb083a4cdc26515fc19. started... 2023-09-19 20:02:51,978 DEBUG [rs(jenkins-hbase4.apache.org,45123,1695153672695)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695153770931.6a0d693a9122f7d826fbbc146dbae1a1. started... 2023-09-19 20:02:51,977 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-19 20:02:51,977 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-19 20:02:51,978 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-19 20:02:51,978 INFO [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] regionserver.HRegion(2745): Flushing d5e34b770e2f4bb083a4cdc26515fc19 1/1 column families, dataSize=2.87 KB heapSize=6.44 KB 2023-09-19 20:02:51,978 INFO [rs(jenkins-hbase4.apache.org,45123,1695153672695)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 6a0d693a9122f7d826fbbc146dbae1a1 1/1 column families, dataSize=400 B heapSize=1.09 KB 2023-09-19 20:02:51,979 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-19 20:02:51,979 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 20:02:51,979 DEBUG [member: 'jenkins-hbase4.apache.org,40839,1695153672784' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-19 20:02:52,001 INFO [rs(jenkins-hbase4.apache.org,45123,1695153672695)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023091970154a241e8a4dcabc91108bd9179d92 to hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023091970154a241e8a4dcabc91108bd9179d92 2023-09-19 20:02:52,001 INFO [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230919bc408654984040d8b5bd60a518ae94ec to hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230919bc408654984040d8b5bd60a518ae94ec 2023-09-19 20:02:52,009 INFO [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemStateWithSkipTmp/d5e34b770e2f4bb083a4cdc26515fc19/.tmp/cf/853e160253c44514b3e58f0ba875fa01 2023-09-19 20:02:52,011 INFO [rs(jenkins-hbase4.apache.org,45123,1695153672695)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=400, hasBloomFilter=true, into tmp file hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemStateWithSkipTmp/6a0d693a9122f7d826fbbc146dbae1a1/.tmp/cf/c7e67ac866f44e41b22f5ac5b9c722cd 2023-09-19 20:02:52,013 DEBUG [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemStateWithSkipTmp/d5e34b770e2f4bb083a4cdc26515fc19/.tmp/cf/853e160253c44514b3e58f0ba875fa01 as hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemStateWithSkipTmp/d5e34b770e2f4bb083a4cdc26515fc19/cf/853e160253c44514b3e58f0ba875fa01 2023-09-19 20:02:52,018 DEBUG [rs(jenkins-hbase4.apache.org,45123,1695153672695)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemStateWithSkipTmp/6a0d693a9122f7d826fbbc146dbae1a1/.tmp/cf/c7e67ac866f44e41b22f5ac5b9c722cd as hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemStateWithSkipTmp/6a0d693a9122f7d826fbbc146dbae1a1/cf/c7e67ac866f44e41b22f5ac5b9c722cd 2023-09-19 20:02:52,019 INFO [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemStateWithSkipTmp/d5e34b770e2f4bb083a4cdc26515fc19/cf/853e160253c44514b3e58f0ba875fa01, entries=44, sequenceid=6, filesize=12.8 K 2023-09-19 20:02:52,020 INFO [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.87 KB/2936, heapSize ~6.42 KB/6576, currentSize=0 B/0 for d5e34b770e2f4bb083a4cdc26515fc19 in 42ms, sequenceid=6, compaction requested=false 2023-09-19 20:02:52,020 DEBUG [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-09-19 20:02:52,021 DEBUG [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d5e34b770e2f4bb083a4cdc26515fc19: 2023-09-19 20:02:52,021 DEBUG [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1695153770931.d5e34b770e2f4bb083a4cdc26515fc19.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:52,021 DEBUG [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-19 20:02:52,021 DEBUG [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemStateWithSkipTmp/d5e34b770e2f4bb083a4cdc26515fc19/cf/853e160253c44514b3e58f0ba875fa01] hfiles 2023-09-19 20:02:52,021 DEBUG [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemStateWithSkipTmp/d5e34b770e2f4bb083a4cdc26515fc19/cf/853e160253c44514b3e58f0ba875fa01 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:52,023 INFO [rs(jenkins-hbase4.apache.org,45123,1695153672695)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemStateWithSkipTmp/6a0d693a9122f7d826fbbc146dbae1a1/cf/c7e67ac866f44e41b22f5ac5b9c722cd, entries=6, sequenceid=6, filesize=6.0 K 2023-09-19 20:02:52,023 INFO [rs(jenkins-hbase4.apache.org,45123,1695153672695)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~400 B/400, heapSize ~1.08 KB/1104, currentSize=0 B/0 for 6a0d693a9122f7d826fbbc146dbae1a1 in 45ms, sequenceid=6, compaction requested=false 2023-09-19 20:02:52,025 DEBUG [rs(jenkins-hbase4.apache.org,45123,1695153672695)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6a0d693a9122f7d826fbbc146dbae1a1: 2023-09-19 20:02:52,025 DEBUG [rs(jenkins-hbase4.apache.org,45123,1695153672695)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1695153770931.6a0d693a9122f7d826fbbc146dbae1a1.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:52,025 DEBUG [rs(jenkins-hbase4.apache.org,45123,1695153672695)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-19 20:02:52,025 DEBUG [rs(jenkins-hbase4.apache.org,45123,1695153672695)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemStateWithSkipTmp/6a0d693a9122f7d826fbbc146dbae1a1/cf/c7e67ac866f44e41b22f5ac5b9c722cd] hfiles 2023-09-19 20:02:52,025 DEBUG [rs(jenkins-hbase4.apache.org,45123,1695153672695)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemStateWithSkipTmp/6a0d693a9122f7d826fbbc146dbae1a1/cf/c7e67ac866f44e41b22f5ac5b9c722cd for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:52,033 DEBUG [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695153770931.d5e34b770e2f4bb083a4cdc26515fc19. completed. 2023-09-19 20:02:52,033 DEBUG [rs(jenkins-hbase4.apache.org,40397,1695153672742)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695153770931.d5e34b770e2f4bb083a4cdc26515fc19. 2023-09-19 20:02:52,033 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-19 20:02:52,033 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-19 20:02:52,033 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:52,036 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-19 20:02:52,036 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,40397,1695153672742' in zk 2023-09-19 20:02:52,038 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:52,038 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-19 20:02:52,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:52,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 20:02:52,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 20:02:52,038 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 20:02:52,038 DEBUG [member: 'jenkins-hbase4.apache.org,40397,1695153672742' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-19 20:02:52,040 DEBUG [Listener at jenkins-hbase4.apache.org/45213] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-19 20:02:52,038 DEBUG [rs(jenkins-hbase4.apache.org,45123,1695153672695)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695153770931.6a0d693a9122f7d826fbbc146dbae1a1. completed. 2023-09-19 20:02:52,040 DEBUG [rs(jenkins-hbase4.apache.org,45123,1695153672695)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695153770931.6a0d693a9122f7d826fbbc146dbae1a1. 2023-09-19 20:02:52,040 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-19 20:02:52,040 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-19 20:02:52,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 20:02:52,040 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:52,040 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-19 20:02:52,040 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,45123,1695153672695' in zk 2023-09-19 20:02:52,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 20:02:52,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-19 20:02:52,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-09-19 20:02:52,041 DEBUG [Listener at jenkins-hbase4.apache.org/45213] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-19 20:02:52,042 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:52,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:52,042 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-19 20:02:52,042 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 20:02:52,042 DEBUG [member: 'jenkins-hbase4.apache.org,45123,1695153672695' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-19 20:02:52,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:52,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:52,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:52,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 20:02:52,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:52,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:52,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:52,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:52,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,40397,1695153672742': 2023-09-19 20:02:52,045 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40397,1695153672742' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-09-19 20:02:52,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:52,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 20:02:52,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 20:02:52,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 20:02:52,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 20:02:52,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:52,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:52,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:52,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:52,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 20:02:52,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:52,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:52,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:52,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:52,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,45123,1695153672695': 2023-09-19 20:02:52,048 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45123,1695153672695' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-09-19 20:02:52,048 INFO [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-09-19 20:02:52,048 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-19 20:02:52,048 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-19 20:02:52,048 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:52,048 INFO [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-19 20:02:52,051 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:52,051 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:52,051 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:52,051 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:52,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:52,051 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 20:02:52,051 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 20:02:52,051 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:52,051 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:52,051 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:52,051 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 20:02:52,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:52,051 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 20:02:52,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:52,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:52,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 20:02:52,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 20:02:52,051 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:52,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 20:02:52,052 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 20:02:52,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 20:02:52,051 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 20:02:52,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 20:02:52,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 20:02:52,052 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:52,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:52,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:52,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:52,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:52,053 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:52,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 20:02:52,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:52,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:52,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:52,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:52,054 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:52,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 20:02:52,054 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:52,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:52,055 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:52,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:52,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:52,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:52,057 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:52,057 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:52,057 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 20:02:52,057 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 20:02:52,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 20:02:52,057 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 20:02:52,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 20:02:52,057 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 20:02:52,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 20:02:52,057 DEBUG [(jenkins-hbase4.apache.org,37929,1695153671462)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 20:02:52,057 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 20:02:52,057 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 20:02:52,057 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:52,057 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:52,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 20:02:52,059 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 20:02:52,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 20:02:52,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 20:02:52,059 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:52,059 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:52,059 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:52,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 20:02:52,059 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 20:02:52,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 20:02:52,059 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-19 20:02:52,059 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:52,059 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:02:52,059 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:52,059 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:02:52,059 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:02:52,059 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 20:02:52,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 20:02:52,059 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:52,060 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:52,060 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230919bc408654984040d8b5bd60a518ae94ec, hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023091970154a241e8a4dcabc91108bd9179d92] mob files 2023-09-19 20:02:52,060 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230919bc408654984040d8b5bd60a518ae94ec 2023-09-19 20:02:52,060 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023091970154a241e8a4dcabc91108bd9179d92 2023-09-19 20:02:52,066 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:52,067 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:52,081 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:52,082 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-09-19 20:02:52,082 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:52,082 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:52,082 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1695153771938Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1695153772066 (+128 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1695153772066Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1695153772066Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1695153772069 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1695153772076 (+7 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1695153772082 (+6 ms) 2023-09-19 20:02:52,084 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-19 20:02:52,086 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 146 msec 2023-09-19 20:02:52,241 DEBUG [Listener at jenkins-hbase4.apache.org/45213] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-19 20:02:52,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-19 20:02:52,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-19 20:02:52,242 INFO [Listener at jenkins-hbase4.apache.org/45213] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/export-test/export-1695153772242 2023-09-19 20:02:52,242 INFO [Listener at jenkins-hbase4.apache.org/45213] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:38739, tgtDir=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/export-test/export-1695153772242, rawTgtDir=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/export-test/export-1695153772242, srcFsUri=hdfs://localhost:38739, srcDir=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf 2023-09-19 20:02:52,264 DEBUG [Listener at jenkins-hbase4.apache.org/45213] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:38739, inputRoot=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf 2023-09-19 20:02:52,264 DEBUG [Listener at jenkins-hbase4.apache.org/45213] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-70692463_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/export-test/export-1695153772242, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/export-test/export-1695153772242/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:52,264 INFO [Listener at jenkins-hbase4.apache.org/45213] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:38739, inputRoot=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf, snapshotDir=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-09-19 20:02:52,275 INFO [Listener at jenkins-hbase4.apache.org/45213] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/export-test/export-1695153772242/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:02:52,288 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-19 20:02:52,288 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-19 20:02:52,289 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-19 20:02:52,289 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-19 20:02:53,160 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59/hadoop-7757374188038602212.jar 2023-09-19 20:02:53,160 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-19 20:02:53,160 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-19 20:02:53,226 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59/hadoop-763755903716643070.jar 2023-09-19 20:02:53,227 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-19 20:02:53,227 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-19 20:02:53,228 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-19 20:02:53,228 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-19 20:02:53,228 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-19 20:02:53,229 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-19 20:02:53,229 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-19 20:02:53,229 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-19 20:02:53,230 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-19 20:02:53,230 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-19 20:02:53,230 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-19 20:02:53,231 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-19 20:02:53,231 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-19 20:02:53,231 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-19 20:02:53,232 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-19 20:02:53,232 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-19 20:02:53,233 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-19 20:02:53,233 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-19 20:02:53,234 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-19 20:02:53,234 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-19 20:02:53,234 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-19 20:02:53,234 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-19 20:02:53,235 DEBUG [Listener at jenkins-hbase4.apache.org/45213] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-19 20:02:53,567 WARN [Listener at jenkins-hbase4.apache.org/45213] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-19 20:02:53,569 INFO [Listener at jenkins-hbase4.apache.org/45213] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-09-19 20:02:53,571 DEBUG [Listener at jenkins-hbase4.apache.org/45213] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-09-19 20:02:55,450 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-19 20:02:55,450 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-19 20:02:55,457 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695153679175_0006_000001 (auth:SIMPLE) 2023-09-19 20:02:55,785 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695153679175_0007_000001 (auth:SIMPLE) 2023-09-19 20:02:56,205 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-19 20:02:59,472 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695153679175_0007_000001 (auth:SIMPLE) 2023-09-19 20:03:01,681 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695153679175_0007_000001 (auth:SIMPLE) 2023-09-19 20:03:04,232 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695153679175_0007_000001 (auth:SIMPLE) 2023-09-19 20:03:05,746 INFO [Listener at jenkins-hbase4.apache.org/45213] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-19 20:03:05,746 INFO [Listener at jenkins-hbase4.apache.org/45213] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-19 20:03:05,759 INFO [Listener at jenkins-hbase4.apache.org/45213] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:03:05,759 INFO [Listener at jenkins-hbase4.apache.org/45213] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-19 20:03:05,760 INFO [Listener at jenkins-hbase4.apache.org/45213] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-19 20:03:05,760 DEBUG [Listener at jenkins-hbase4.apache.org/45213] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1909323301_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:03:05,761 DEBUG [Listener at jenkins-hbase4.apache.org/45213] snapshot.TestExportSnapshot(367): hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-09-19 20:03:05,761 DEBUG [Listener at jenkins-hbase4.apache.org/45213] snapshot.TestExportSnapshot(367): hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-09-19 20:03:05,761 DEBUG [Listener at jenkins-hbase4.apache.org/45213] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1909323301_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/export-test/export-1695153772242/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/export-test/export-1695153772242/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:03:05,761 DEBUG [Listener at jenkins-hbase4.apache.org/45213] snapshot.TestExportSnapshot(367): hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/export-test/export-1695153772242/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-09-19 20:03:05,761 DEBUG [Listener at jenkins-hbase4.apache.org/45213] snapshot.TestExportSnapshot(367): hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/export-test/export-1695153772242/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-09-19 20:03:05,768 INFO [Listener at jenkins-hbase4.apache.org/45213] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-09-19 20:03:05,768 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-09-19 20:03:05,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] procedure2.ProcedureExecutor(1028): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-19 20:03:05,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-19 20:03:05,772 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695153785772"}]},"ts":"1695153785772"} 2023-09-19 20:03:05,773 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-09-19 20:03:05,775 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-09-19 20:03:05,775 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6a0d693a9122f7d826fbbc146dbae1a1, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d5e34b770e2f4bb083a4cdc26515fc19, UNASSIGN}] 2023-09-19 20:03:05,777 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6a0d693a9122f7d826fbbc146dbae1a1, UNASSIGN 2023-09-19 20:03:05,777 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d5e34b770e2f4bb083a4cdc26515fc19, UNASSIGN 2023-09-19 20:03:05,778 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=6a0d693a9122f7d826fbbc146dbae1a1, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:03:05,778 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=d5e34b770e2f4bb083a4cdc26515fc19, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:03:05,778 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695153770931.6a0d693a9122f7d826fbbc146dbae1a1.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695153785778"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695153785778"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695153785778"}]},"ts":"1695153785778"} 2023-09-19 20:03:05,778 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695153770931.d5e34b770e2f4bb083a4cdc26515fc19.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695153785778"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695153785778"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695153785778"}]},"ts":"1695153785778"} 2023-09-19 20:03:05,779 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure 6a0d693a9122f7d826fbbc146dbae1a1, server=jenkins-hbase4.apache.org,45123,1695153672695}] 2023-09-19 20:03:05,780 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure d5e34b770e2f4bb083a4cdc26515fc19, server=jenkins-hbase4.apache.org,40397,1695153672742}] 2023-09-19 20:03:05,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-19 20:03:05,932 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 6a0d693a9122f7d826fbbc146dbae1a1 2023-09-19 20:03:05,932 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6a0d693a9122f7d826fbbc146dbae1a1, disabling compactions & flushes 2023-09-19 20:03:05,932 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1695153770931.6a0d693a9122f7d826fbbc146dbae1a1. 2023-09-19 20:03:05,932 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695153770931.6a0d693a9122f7d826fbbc146dbae1a1. 2023-09-19 20:03:05,932 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695153770931.6a0d693a9122f7d826fbbc146dbae1a1. after waiting 0 ms 2023-09-19 20:03:05,932 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1695153770931.6a0d693a9122f7d826fbbc146dbae1a1. 2023-09-19 20:03:05,936 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close d5e34b770e2f4bb083a4cdc26515fc19 2023-09-19 20:03:05,936 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d5e34b770e2f4bb083a4cdc26515fc19, disabling compactions & flushes 2023-09-19 20:03:05,936 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1695153770931.d5e34b770e2f4bb083a4cdc26515fc19. 2023-09-19 20:03:05,936 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695153770931.d5e34b770e2f4bb083a4cdc26515fc19. 2023-09-19 20:03:05,936 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695153770931.d5e34b770e2f4bb083a4cdc26515fc19. after waiting 0 ms 2023-09-19 20:03:05,936 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1695153770931.d5e34b770e2f4bb083a4cdc26515fc19. 2023-09-19 20:03:05,943 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemStateWithSkipTmp/6a0d693a9122f7d826fbbc146dbae1a1/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-19 20:03:05,943 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/default/testtb-testExportFileSystemStateWithSkipTmp/d5e34b770e2f4bb083a4cdc26515fc19/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-19 20:03:05,944 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-19 20:03:05,944 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-19 20:03:05,945 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1695153770931.6a0d693a9122f7d826fbbc146dbae1a1. 2023-09-19 20:03:05,945 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6a0d693a9122f7d826fbbc146dbae1a1: 2023-09-19 20:03:05,945 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1695153770931.d5e34b770e2f4bb083a4cdc26515fc19. 2023-09-19 20:03:05,945 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d5e34b770e2f4bb083a4cdc26515fc19: 2023-09-19 20:03:05,947 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 6a0d693a9122f7d826fbbc146dbae1a1 2023-09-19 20:03:05,947 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=6a0d693a9122f7d826fbbc146dbae1a1, regionState=CLOSED 2023-09-19 20:03:05,947 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695153770931.6a0d693a9122f7d826fbbc146dbae1a1.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695153785947"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695153785947"}]},"ts":"1695153785947"} 2023-09-19 20:03:05,947 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed d5e34b770e2f4bb083a4cdc26515fc19 2023-09-19 20:03:05,948 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=d5e34b770e2f4bb083a4cdc26515fc19, regionState=CLOSED 2023-09-19 20:03:05,948 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695153770931.d5e34b770e2f4bb083a4cdc26515fc19.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695153785948"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695153785948"}]},"ts":"1695153785948"} 2023-09-19 20:03:05,950 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=117, resume processing ppid=115 2023-09-19 20:03:05,950 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure 6a0d693a9122f7d826fbbc146dbae1a1, server=jenkins-hbase4.apache.org,45123,1695153672695 in 170 msec 2023-09-19 20:03:05,951 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=118, resume processing ppid=116 2023-09-19 20:03:05,951 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure d5e34b770e2f4bb083a4cdc26515fc19, server=jenkins-hbase4.apache.org,40397,1695153672742 in 170 msec 2023-09-19 20:03:05,951 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6a0d693a9122f7d826fbbc146dbae1a1, UNASSIGN in 175 msec 2023-09-19 20:03:05,953 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=116, resume processing ppid=114 2023-09-19 20:03:05,953 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d5e34b770e2f4bb083a4cdc26515fc19, UNASSIGN in 176 msec 2023-09-19 20:03:05,953 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695153785953"}]},"ts":"1695153785953"} 2023-09-19 20:03:05,954 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-09-19 20:03:05,956 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-09-19 20:03:05,957 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 188 msec 2023-09-19 20:03:06,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-19 20:03:06,073 INFO [Listener at jenkins-hbase4.apache.org/45213] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-09-19 20:03:06,074 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-09-19 20:03:06,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] procedure2.ProcedureExecutor(1028): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-19 20:03:06,077 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-19 20:03:06,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-09-19 20:03:06,078 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-19 20:03:06,079 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40839] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-09-19 20:03:06,081 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6a0d693a9122f7d826fbbc146dbae1a1 2023-09-19 20:03:06,081 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d5e34b770e2f4bb083a4cdc26515fc19 2023-09-19 20:03:06,082 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-19 20:03:06,082 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-19 20:03:06,082 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-19 20:03:06,082 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-19 20:03:06,083 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-19 20:03:06,083 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-19 20:03:06,083 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-19 20:03:06,083 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-19 20:03:06,083 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6a0d693a9122f7d826fbbc146dbae1a1/cf, FileablePath, hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6a0d693a9122f7d826fbbc146dbae1a1/recovered.edits] 2023-09-19 20:03:06,083 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d5e34b770e2f4bb083a4cdc26515fc19/cf, FileablePath, hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d5e34b770e2f4bb083a4cdc26515fc19/recovered.edits] 2023-09-19 20:03:06,083 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-19 20:03:06,083 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-19 20:03:06,083 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 20:03:06,083 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-19 20:03:06,083 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 20:03:06,083 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-19 20:03:06,084 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 20:03:06,084 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 20:03:06,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-09-19 20:03:06,087 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6a0d693a9122f7d826fbbc146dbae1a1/cf/c7e67ac866f44e41b22f5ac5b9c722cd to hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/6a0d693a9122f7d826fbbc146dbae1a1/cf/c7e67ac866f44e41b22f5ac5b9c722cd 2023-09-19 20:03:06,087 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d5e34b770e2f4bb083a4cdc26515fc19/cf/853e160253c44514b3e58f0ba875fa01 to hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/d5e34b770e2f4bb083a4cdc26515fc19/cf/853e160253c44514b3e58f0ba875fa01 2023-09-19 20:03:06,090 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6a0d693a9122f7d826fbbc146dbae1a1/recovered.edits/9.seqid to hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/6a0d693a9122f7d826fbbc146dbae1a1/recovered.edits/9.seqid 2023-09-19 20:03:06,090 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d5e34b770e2f4bb083a4cdc26515fc19/recovered.edits/9.seqid to hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/d5e34b770e2f4bb083a4cdc26515fc19/recovered.edits/9.seqid 2023-09-19 20:03:06,090 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6a0d693a9122f7d826fbbc146dbae1a1 2023-09-19 20:03:06,091 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d5e34b770e2f4bb083a4cdc26515fc19 2023-09-19 20:03:06,091 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-09-19 20:03:06,091 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-09-19 20:03:06,092 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-09-19 20:03:06,095 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230919bc408654984040d8b5bd60a518ae94ec to hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230919bc408654984040d8b5bd60a518ae94ec 2023-09-19 20:03:06,096 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023091970154a241e8a4dcabc91108bd9179d92 to hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023091970154a241e8a4dcabc91108bd9179d92 2023-09-19 20:03:06,096 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-09-19 20:03:06,098 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-19 20:03:06,100 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-09-19 20:03:06,102 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-09-19 20:03:06,103 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-19 20:03:06,103 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-09-19 20:03:06,103 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695153770931.6a0d693a9122f7d826fbbc146dbae1a1.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695153786103"}]},"ts":"9223372036854775807"} 2023-09-19 20:03:06,103 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695153770931.d5e34b770e2f4bb083a4cdc26515fc19.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695153786103"}]},"ts":"9223372036854775807"} 2023-09-19 20:03:06,104 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-19 20:03:06,104 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 6a0d693a9122f7d826fbbc146dbae1a1, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1695153770931.6a0d693a9122f7d826fbbc146dbae1a1.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => d5e34b770e2f4bb083a4cdc26515fc19, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1695153770931.d5e34b770e2f4bb083a4cdc26515fc19.', STARTKEY => '1', ENDKEY => ''}] 2023-09-19 20:03:06,104 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-09-19 20:03:06,105 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695153786104"}]},"ts":"9223372036854775807"} 2023-09-19 20:03:06,107 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-09-19 20:03:06,109 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-19 20:03:06,110 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 35 msec 2023-09-19 20:03:06,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-09-19 20:03:06,186 INFO [Listener at jenkins-hbase4.apache.org/45213] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-09-19 20:03:06,192 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-09-19 20:03:06,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:03:06,195 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-09-19 20:03:06,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37929] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 20:03:06,221 INFO [Listener at jenkins-hbase4.apache.org/45213] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=767 (was 766) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-502044557_1 at /127.0.0.1:50590 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x51b5961f-shared-pool-40 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5330 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x51b5961f-shared-pool-41 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-502044557_1 at /127.0.0.1:58834 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x51b5961f-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1909323301_17 at /127.0.0.1:57808 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1909323301_17 at /127.0.0.1:53398 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1909323301_17 at /127.0.0.1:35352 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1781244183) connection to jenkins-hbase4.apache.org/172.31.14.131:42785 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x51b5961f-shared-pool-42 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=911 (was 929), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=225 (was 231), ProcessCount=168 (was 168), AvailableMemoryMB=7355 (was 7436) 2023-09-19 20:03:06,221 WARN [Listener at jenkins-hbase4.apache.org/45213] hbase.ResourceChecker(130): Thread=767 is superior to 500 2023-09-19 20:03:06,221 INFO [Listener at jenkins-hbase4.apache.org/45213] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-09-19 20:03:06,231 INFO [Listener at jenkins-hbase4.apache.org/45213] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-19 20:03:10,406 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695153679175_0007_000001 (auth:SIMPLE) 2023-09-19 20:03:11,510 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-19 20:03:20,352 INFO [Listener at jenkins-hbase4.apache.org/45213] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-19 20:03:34,466 ERROR [Thread[Thread-408,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-19 20:03:34,467 INFO [Listener at jenkins-hbase4.apache.org/45213] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-19 20:03:34,574 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-09-19 20:03:34,581 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-09-19 20:03:34,582 ERROR [Thread[Thread-418,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-19 20:03:34,588 INFO [Listener at jenkins-hbase4.apache.org/45213] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-19 20:03:34,692 ERROR [Thread[Thread-383,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-19 20:03:34,692 INFO [Listener at jenkins-hbase4.apache.org/45213] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-09-19 20:03:34,692 INFO [Listener at jenkins-hbase4.apache.org/45213] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-09-19 20:03:34,692 INFO [Listener at jenkins-hbase4.apache.org/45213] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-09-19 20:03:34,692 DEBUG [Listener at jenkins-hbase4.apache.org/45213] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3a20d86f to 127.0.0.1:60323 2023-09-19 20:03:34,692 DEBUG [Listener at jenkins-hbase4.apache.org/45213] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 20:03:34,693 DEBUG [Listener at jenkins-hbase4.apache.org/45213] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-09-19 20:03:34,693 DEBUG [Listener at jenkins-hbase4.apache.org/45213] util.JVMClusterUtil(257): Found active master hash=1497022553, stopped=false 2023-09-19 20:03:34,693 DEBUG [Listener at jenkins-hbase4.apache.org/45213] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-19 20:03:34,693 DEBUG [Listener at jenkins-hbase4.apache.org/45213] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-09-19 20:03:34,693 INFO [Listener at jenkins-hbase4.apache.org/45213] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,37929,1695153671462 2023-09-19 20:03:34,695 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-19 20:03:34,695 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-19 20:03:34,695 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-19 20:03:34,695 INFO [Listener at jenkins-hbase4.apache.org/45213] procedure2.ProcedureExecutor(628): Stopping 2023-09-19 20:03:34,695 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-19 20:03:34,695 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-19 20:03:34,695 DEBUG [Listener at jenkins-hbase4.apache.org/45213] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x056403ec to 127.0.0.1:60323 2023-09-19 20:03:34,695 DEBUG [Listener at jenkins-hbase4.apache.org/45213] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 20:03:34,695 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-19 20:03:34,695 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-19 20:03:34,695 INFO [Listener at jenkins-hbase4.apache.org/45213] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,45123,1695153672695' ***** 2023-09-19 20:03:34,695 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-19 20:03:34,696 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-19 20:03:34,696 DEBUG [Listener at jenkins-hbase4.apache.org/45213] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-19 20:03:34,696 INFO [Listener at jenkins-hbase4.apache.org/45213] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-19 20:03:34,696 INFO [Listener at jenkins-hbase4.apache.org/45213] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,40397,1695153672742' ***** 2023-09-19 20:03:34,696 DEBUG [Listener at jenkins-hbase4.apache.org/45213] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-19 20:03:34,696 INFO [Listener at jenkins-hbase4.apache.org/45213] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-19 20:03:34,696 INFO [Listener at jenkins-hbase4.apache.org/45213] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,40839,1695153672784' ***** 2023-09-19 20:03:34,696 INFO [RS:0;jenkins-hbase4:45123] regionserver.HeapMemoryManager(220): Stopping 2023-09-19 20:03:34,696 DEBUG [Listener at jenkins-hbase4.apache.org/45213] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-19 20:03:34,696 INFO [RS:1;jenkins-hbase4:40397] regionserver.HeapMemoryManager(220): Stopping 2023-09-19 20:03:34,696 INFO [RS:0;jenkins-hbase4:45123] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-19 20:03:34,696 INFO [Listener at jenkins-hbase4.apache.org/45213] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-19 20:03:34,696 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-19 20:03:34,696 INFO [RS:0;jenkins-hbase4:45123] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-19 20:03:34,696 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-19 20:03:34,696 INFO [RS:1;jenkins-hbase4:40397] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-19 20:03:34,697 INFO [RS:0;jenkins-hbase4:45123] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:03:34,697 INFO [RS:2;jenkins-hbase4:40839] regionserver.HeapMemoryManager(220): Stopping 2023-09-19 20:03:34,697 DEBUG [RS:0;jenkins-hbase4:45123] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x79a2bbc8 to 127.0.0.1:60323 2023-09-19 20:03:34,697 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-19 20:03:34,697 DEBUG [RS:0;jenkins-hbase4:45123] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 20:03:34,697 INFO [RS:1;jenkins-hbase4:40397] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-19 20:03:34,697 INFO [RS:2;jenkins-hbase4:40839] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-19 20:03:34,700 INFO [RS:0;jenkins-hbase4:45123] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-19 20:03:34,700 INFO [RS:2;jenkins-hbase4:40839] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-19 20:03:34,700 INFO [RS:1;jenkins-hbase4:40397] regionserver.HRegionServer(3305): Received CLOSE for 5cf9e8f3ef3edde93a47c370d861e6b1 2023-09-19 20:03:34,700 INFO [RS:0;jenkins-hbase4:45123] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-19 20:03:34,700 INFO [RS:2;jenkins-hbase4:40839] regionserver.HRegionServer(3305): Received CLOSE for d044ee20801cef30a33f2410eddbecac 2023-09-19 20:03:34,700 INFO [RS:0;jenkins-hbase4:45123] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-19 20:03:34,700 INFO [RS:0;jenkins-hbase4:45123] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-09-19 20:03:34,700 INFO [RS:1;jenkins-hbase4:40397] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:03:34,700 INFO [RS:2;jenkins-hbase4:40839] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:03:34,700 DEBUG [RS:1;jenkins-hbase4:40397] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x55bf031d to 127.0.0.1:60323 2023-09-19 20:03:34,700 DEBUG [RS:2;jenkins-hbase4:40839] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x563f9214 to 127.0.0.1:60323 2023-09-19 20:03:34,700 DEBUG [RS:1;jenkins-hbase4:40397] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 20:03:34,701 DEBUG [RS:2;jenkins-hbase4:40839] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 20:03:34,701 INFO [RS:1;jenkins-hbase4:40397] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-09-19 20:03:34,702 INFO [RS:2;jenkins-hbase4:40839] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-09-19 20:03:34,702 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-09-19 20:03:34,702 DEBUG [RS:2;jenkins-hbase4:40839] regionserver.HRegionServer(1478): Online Regions={d044ee20801cef30a33f2410eddbecac=hbase:acl,,1695153675699.d044ee20801cef30a33f2410eddbecac.} 2023-09-19 20:03:34,702 DEBUG [RS:1;jenkins-hbase4:40397] regionserver.HRegionServer(1478): Online Regions={5cf9e8f3ef3edde93a47c370d861e6b1=hbase:namespace,,1695153674949.5cf9e8f3ef3edde93a47c370d861e6b1.} 2023-09-19 20:03:34,702 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-09-19 20:03:34,701 INFO [RS:0;jenkins-hbase4:45123] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-09-19 20:03:34,701 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d044ee20801cef30a33f2410eddbecac, disabling compactions & flushes 2023-09-19 20:03:34,701 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5cf9e8f3ef3edde93a47c370d861e6b1, disabling compactions & flushes 2023-09-19 20:03:34,703 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1695153675699.d044ee20801cef30a33f2410eddbecac. 2023-09-19 20:03:34,703 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1695153674949.5cf9e8f3ef3edde93a47c370d861e6b1. 2023-09-19 20:03:34,703 DEBUG [RS:0;jenkins-hbase4:45123] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-09-19 20:03:34,703 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-09-19 20:03:34,703 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1695153674949.5cf9e8f3ef3edde93a47c370d861e6b1. 2023-09-19 20:03:34,703 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1695153675699.d044ee20801cef30a33f2410eddbecac. 2023-09-19 20:03:34,703 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1695153674949.5cf9e8f3ef3edde93a47c370d861e6b1. after waiting 0 ms 2023-09-19 20:03:34,703 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1695153675699.d044ee20801cef30a33f2410eddbecac. after waiting 0 ms 2023-09-19 20:03:34,703 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-09-19 20:03:34,703 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1695153675699.d044ee20801cef30a33f2410eddbecac. 2023-09-19 20:03:34,703 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-09-19 20:03:34,703 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1695153674949.5cf9e8f3ef3edde93a47c370d861e6b1. 2023-09-19 20:03:34,703 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing d044ee20801cef30a33f2410eddbecac 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-09-19 20:03:34,703 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 5cf9e8f3ef3edde93a47c370d861e6b1 1/1 column families, dataSize=78 B heapSize=488 B 2023-09-19 20:03:34,703 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-09-19 20:03:34,703 DEBUG [RS:0;jenkins-hbase4:45123] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-09-19 20:03:34,703 DEBUG [RS:2;jenkins-hbase4:40839] regionserver.HRegionServer(1504): Waiting on d044ee20801cef30a33f2410eddbecac 2023-09-19 20:03:34,703 DEBUG [RS:1;jenkins-hbase4:40397] regionserver.HRegionServer(1504): Waiting on 5cf9e8f3ef3edde93a47c370d861e6b1 2023-09-19 20:03:34,732 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/hbase/meta/1588230740/.tmp/info/50755a370f5b4433ba07cc45a343a542 2023-09-19 20:03:34,737 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/hbase/namespace/5cf9e8f3ef3edde93a47c370d861e6b1/.tmp/info/b8dde994424048e690aac4b14bae0f60 2023-09-19 20:03:34,737 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/hbase/acl/d044ee20801cef30a33f2410eddbecac/.tmp/l/1925b2f07c2f49da9d69494cd35ff9d1 2023-09-19 20:03:34,739 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 50755a370f5b4433ba07cc45a343a542 2023-09-19 20:03:34,742 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1925b2f07c2f49da9d69494cd35ff9d1 2023-09-19 20:03:34,742 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/hbase/acl/d044ee20801cef30a33f2410eddbecac/.tmp/l/1925b2f07c2f49da9d69494cd35ff9d1 as hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/hbase/acl/d044ee20801cef30a33f2410eddbecac/l/1925b2f07c2f49da9d69494cd35ff9d1 2023-09-19 20:03:34,747 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1925b2f07c2f49da9d69494cd35ff9d1 2023-09-19 20:03:34,747 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/hbase/acl/d044ee20801cef30a33f2410eddbecac/l/1925b2f07c2f49da9d69494cd35ff9d1, entries=7, sequenceid=18, filesize=5.2 K 2023-09-19 20:03:34,748 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for d044ee20801cef30a33f2410eddbecac in 45ms, sequenceid=18, compaction requested=false 2023-09-19 20:03:34,754 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/hbase/namespace/5cf9e8f3ef3edde93a47c370d861e6b1/.tmp/info/b8dde994424048e690aac4b14bae0f60 as hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/hbase/namespace/5cf9e8f3ef3edde93a47c370d861e6b1/info/b8dde994424048e690aac4b14bae0f60 2023-09-19 20:03:34,757 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/hbase/acl/d044ee20801cef30a33f2410eddbecac/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-09-19 20:03:34,758 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-19 20:03:34,759 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1695153675699.d044ee20801cef30a33f2410eddbecac. 2023-09-19 20:03:34,759 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d044ee20801cef30a33f2410eddbecac: 2023-09-19 20:03:34,759 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1695153675699.d044ee20801cef30a33f2410eddbecac. 2023-09-19 20:03:34,759 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/hbase/namespace/5cf9e8f3ef3edde93a47c370d861e6b1/info/b8dde994424048e690aac4b14bae0f60, entries=2, sequenceid=6, filesize=4.8 K 2023-09-19 20:03:34,760 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 5cf9e8f3ef3edde93a47c370d861e6b1 in 57ms, sequenceid=6, compaction requested=false 2023-09-19 20:03:34,773 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-19 20:03:34,773 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-19 20:03:34,773 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-19 20:03:34,776 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/hbase/namespace/5cf9e8f3ef3edde93a47c370d861e6b1/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-19 20:03:34,777 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-19 20:03:34,778 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1695153674949.5cf9e8f3ef3edde93a47c370d861e6b1. 2023-09-19 20:03:34,778 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5cf9e8f3ef3edde93a47c370d861e6b1: 2023-09-19 20:03:34,778 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/hbase/meta/1588230740/.tmp/rep_barrier/874eecf421894451b428240e5c93e09f 2023-09-19 20:03:34,778 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1695153674949.5cf9e8f3ef3edde93a47c370d861e6b1. 2023-09-19 20:03:34,783 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 874eecf421894451b428240e5c93e09f 2023-09-19 20:03:34,794 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/hbase/meta/1588230740/.tmp/table/e9ff0d1cd65744b3a0d224fe23712fba 2023-09-19 20:03:34,797 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e9ff0d1cd65744b3a0d224fe23712fba 2023-09-19 20:03:34,798 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/hbase/meta/1588230740/.tmp/info/50755a370f5b4433ba07cc45a343a542 as hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/hbase/meta/1588230740/info/50755a370f5b4433ba07cc45a343a542 2023-09-19 20:03:34,802 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 50755a370f5b4433ba07cc45a343a542 2023-09-19 20:03:34,802 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/hbase/meta/1588230740/info/50755a370f5b4433ba07cc45a343a542, entries=48, sequenceid=131, filesize=10.3 K 2023-09-19 20:03:34,803 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/hbase/meta/1588230740/.tmp/rep_barrier/874eecf421894451b428240e5c93e09f as hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/hbase/meta/1588230740/rep_barrier/874eecf421894451b428240e5c93e09f 2023-09-19 20:03:34,806 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 874eecf421894451b428240e5c93e09f 2023-09-19 20:03:34,806 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/hbase/meta/1588230740/rep_barrier/874eecf421894451b428240e5c93e09f, entries=13, sequenceid=131, filesize=6.4 K 2023-09-19 20:03:34,807 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/hbase/meta/1588230740/.tmp/table/e9ff0d1cd65744b3a0d224fe23712fba as hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/hbase/meta/1588230740/table/e9ff0d1cd65744b3a0d224fe23712fba 2023-09-19 20:03:34,811 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e9ff0d1cd65744b3a0d224fe23712fba 2023-09-19 20:03:34,811 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/hbase/meta/1588230740/table/e9ff0d1cd65744b3a0d224fe23712fba, entries=24, sequenceid=131, filesize=6.9 K 2023-09-19 20:03:34,812 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 109ms, sequenceid=131, compaction requested=false 2023-09-19 20:03:34,822 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-09-19 20:03:34,822 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-19 20:03:34,822 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-09-19 20:03:34,823 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-09-19 20:03:34,823 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-09-19 20:03:34,823 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-09-19 20:03:34,903 INFO [RS:0;jenkins-hbase4:45123] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,45123,1695153672695; all regions closed. 2023-09-19 20:03:34,904 INFO [RS:2;jenkins-hbase4:40839] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,40839,1695153672784; all regions closed. 2023-09-19 20:03:34,904 INFO [RS:1;jenkins-hbase4:40397] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,40397,1695153672742; all regions closed. 2023-09-19 20:03:34,916 DEBUG [RS:2;jenkins-hbase4:40839] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/oldWALs 2023-09-19 20:03:34,916 DEBUG [RS:1;jenkins-hbase4:40397] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/oldWALs 2023-09-19 20:03:34,916 DEBUG [RS:0;jenkins-hbase4:45123] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/oldWALs 2023-09-19 20:03:34,916 INFO [RS:1;jenkins-hbase4:40397] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40397%2C1695153672742:(num 1695153674486) 2023-09-19 20:03:34,916 INFO [RS:2;jenkins-hbase4:40839] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40839%2C1695153672784:(num 1695153674486) 2023-09-19 20:03:34,916 DEBUG [RS:1;jenkins-hbase4:40397] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 20:03:34,916 DEBUG [RS:2;jenkins-hbase4:40839] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 20:03:34,916 INFO [RS:1;jenkins-hbase4:40397] regionserver.LeaseManager(133): Closed leases 2023-09-19 20:03:34,916 INFO [RS:2;jenkins-hbase4:40839] regionserver.LeaseManager(133): Closed leases 2023-09-19 20:03:34,916 INFO [RS:0;jenkins-hbase4:45123] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45123%2C1695153672695.meta:.meta(num 1695153674609) 2023-09-19 20:03:34,917 INFO [RS:2;jenkins-hbase4:40839] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-09-19 20:03:34,917 INFO [RS:1;jenkins-hbase4:40397] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-09-19 20:03:34,917 INFO [RS:2;jenkins-hbase4:40839] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-19 20:03:34,918 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-19 20:03:34,918 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-19 20:03:34,918 INFO [RS:1;jenkins-hbase4:40397] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-19 20:03:34,918 INFO [RS:2;jenkins-hbase4:40839] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-19 20:03:34,918 INFO [RS:1;jenkins-hbase4:40397] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-19 20:03:34,918 INFO [RS:2;jenkins-hbase4:40839] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-19 20:03:34,918 INFO [RS:1;jenkins-hbase4:40397] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-19 20:03:34,920 INFO [RS:1;jenkins-hbase4:40397] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40397 2023-09-19 20:03:34,922 INFO [RS:2;jenkins-hbase4:40839] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40839 2023-09-19 20:03:34,925 DEBUG [RS:0;jenkins-hbase4:45123] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/oldWALs 2023-09-19 20:03:34,925 INFO [RS:0;jenkins-hbase4:45123] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45123%2C1695153672695:(num 1695153674486) 2023-09-19 20:03:34,926 DEBUG [RS:0;jenkins-hbase4:45123] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 20:03:34,926 INFO [RS:0;jenkins-hbase4:45123] regionserver.LeaseManager(133): Closed leases 2023-09-19 20:03:34,926 INFO [RS:0;jenkins-hbase4:45123] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-09-19 20:03:34,926 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-19 20:03:34,927 INFO [RS:0;jenkins-hbase4:45123] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45123 2023-09-19 20:03:34,929 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:03:34,929 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:03:34,929 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45123,1695153672695 2023-09-19 20:03:34,929 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-19 20:03:34,929 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-19 20:03:34,929 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-19 20:03:34,929 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-19 20:03:34,929 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:03:34,929 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:03:34,929 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:03:34,930 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,45123,1695153672695] 2023-09-19 20:03:34,929 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40397,1695153672742 2023-09-19 20:03:34,930 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:03:34,930 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40839,1695153672784 2023-09-19 20:03:34,930 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,45123,1695153672695; numProcessing=1 2023-09-19 20:03:34,933 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,45123,1695153672695 already deleted, retry=false 2023-09-19 20:03:34,933 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,45123,1695153672695 expired; onlineServers=2 2023-09-19 20:03:34,933 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,40839,1695153672784] 2023-09-19 20:03:34,933 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,40839,1695153672784; numProcessing=2 2023-09-19 20:03:34,934 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,40839,1695153672784 already deleted, retry=false 2023-09-19 20:03:34,935 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,40839,1695153672784 expired; onlineServers=1 2023-09-19 20:03:34,935 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,40397,1695153672742] 2023-09-19 20:03:34,935 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,40397,1695153672742; numProcessing=3 2023-09-19 20:03:34,936 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,40397,1695153672742 already deleted, retry=false 2023-09-19 20:03:34,936 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,40397,1695153672742 expired; onlineServers=0 2023-09-19 20:03:34,936 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,37929,1695153671462' ***** 2023-09-19 20:03:34,936 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-09-19 20:03:34,936 DEBUG [M:0;jenkins-hbase4:37929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1807ca62, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-19 20:03:34,936 INFO [M:0;jenkins-hbase4:37929] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,37929,1695153671462 2023-09-19 20:03:34,936 INFO [M:0;jenkins-hbase4:37929] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,37929,1695153671462; all regions closed. 2023-09-19 20:03:34,936 DEBUG [M:0;jenkins-hbase4:37929] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 20:03:34,936 DEBUG [M:0;jenkins-hbase4:37929] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-09-19 20:03:34,936 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-09-19 20:03:34,936 DEBUG [M:0;jenkins-hbase4:37929] cleaner.HFileCleaner(317): Stopping file delete threads 2023-09-19 20:03:34,936 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1695153674097] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1695153674097,5,FailOnTimeoutGroup] 2023-09-19 20:03:34,936 INFO [M:0;jenkins-hbase4:37929] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-09-19 20:03:34,936 INFO [M:0;jenkins-hbase4:37929] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-09-19 20:03:34,936 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1695153674097] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1695153674097,5,FailOnTimeoutGroup] 2023-09-19 20:03:34,937 INFO [M:0;jenkins-hbase4:37929] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-09-19 20:03:34,937 DEBUG [M:0;jenkins-hbase4:37929] master.HMaster(1512): Stopping service threads 2023-09-19 20:03:34,937 INFO [M:0;jenkins-hbase4:37929] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-09-19 20:03:34,937 ERROR [M:0;jenkins-hbase4:37929] procedure2.ProcedureExecutor(652): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-14,5,PEWorkerGroup] Thread[HFileArchiver-15,5,PEWorkerGroup] 2023-09-19 20:03:34,938 INFO [M:0;jenkins-hbase4:37929] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-09-19 20:03:34,938 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-09-19 20:03:34,938 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-09-19 20:03:34,938 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-19 20:03:34,938 DEBUG [M:0;jenkins-hbase4:37929] zookeeper.ZKUtil(398): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-09-19 20:03:34,938 WARN [M:0;jenkins-hbase4:37929] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-09-19 20:03:34,938 INFO [M:0;jenkins-hbase4:37929] assignment.AssignmentManager(315): Stopping assignment manager 2023-09-19 20:03:34,939 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-19 20:03:34,939 INFO [M:0;jenkins-hbase4:37929] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-09-19 20:03:34,939 DEBUG [M:0;jenkins-hbase4:37929] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-09-19 20:03:34,939 INFO [M:0;jenkins-hbase4:37929] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-19 20:03:34,939 DEBUG [M:0;jenkins-hbase4:37929] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-19 20:03:34,939 DEBUG [M:0;jenkins-hbase4:37929] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-09-19 20:03:34,939 DEBUG [M:0;jenkins-hbase4:37929] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-19 20:03:34,939 INFO [M:0;jenkins-hbase4:37929] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.88 KB heapSize=452.14 KB 2023-09-19 20:03:34,955 INFO [M:0;jenkins-hbase4:37929] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.88 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/ee291d47b23241b2984319291a8dfdee 2023-09-19 20:03:34,959 INFO [M:0;jenkins-hbase4:37929] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ee291d47b23241b2984319291a8dfdee 2023-09-19 20:03:34,959 DEBUG [M:0;jenkins-hbase4:37929] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/ee291d47b23241b2984319291a8dfdee as hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/ee291d47b23241b2984319291a8dfdee 2023-09-19 20:03:34,963 INFO [M:0;jenkins-hbase4:37929] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ee291d47b23241b2984319291a8dfdee 2023-09-19 20:03:34,963 INFO [M:0;jenkins-hbase4:37929] regionserver.HStore(1080): Added hdfs://localhost:38739/user/jenkins/test-data/6295bdf6-ea76-5616-500e-9d0192b7ebdf/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/ee291d47b23241b2984319291a8dfdee, entries=119, sequenceid=899, filesize=28.7 K 2023-09-19 20:03:34,964 INFO [M:0;jenkins-hbase4:37929] regionserver.HRegion(2948): Finished flush of dataSize ~375.88 KB/384899, heapSize ~452.13 KB/462976, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 25ms, sequenceid=899, compaction requested=false 2023-09-19 20:03:34,966 INFO [M:0;jenkins-hbase4:37929] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-19 20:03:34,966 DEBUG [M:0;jenkins-hbase4:37929] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-19 20:03:34,969 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-19 20:03:34,969 INFO [M:0;jenkins-hbase4:37929] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-09-19 20:03:34,970 INFO [M:0;jenkins-hbase4:37929] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37929 2023-09-19 20:03:34,971 DEBUG [M:0;jenkins-hbase4:37929] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,37929,1695153671462 already deleted, retry=false 2023-09-19 20:03:35,033 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-19 20:03:35,033 INFO [RS:0;jenkins-hbase4:45123] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,45123,1695153672695; zookeeper connection closed. 2023-09-19 20:03:35,033 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:45123-0x100c5c781040001, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-19 20:03:35,033 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@691f11ef] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@691f11ef 2023-09-19 20:03:35,133 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-19 20:03:35,133 INFO [M:0;jenkins-hbase4:37929] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,37929,1695153671462; zookeeper connection closed. 2023-09-19 20:03:35,133 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): master:37929-0x100c5c781040000, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-19 20:03:35,233 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-19 20:03:35,234 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40397-0x100c5c781040002, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-19 20:03:35,233 INFO [RS:1;jenkins-hbase4:40397] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,40397,1695153672742; zookeeper connection closed. 2023-09-19 20:03:35,234 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@71da5d83] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@71da5d83 2023-09-19 20:03:35,334 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-19 20:03:35,334 DEBUG [Listener at localhost/45791-EventThread] zookeeper.ZKWatcher(600): regionserver:40839-0x100c5c781040003, quorum=127.0.0.1:60323, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-19 20:03:35,334 INFO [RS:2;jenkins-hbase4:40839] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,40839,1695153672784; zookeeper connection closed. 2023-09-19 20:03:35,334 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5e065b56] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5e065b56 2023-09-19 20:03:35,334 INFO [Listener at jenkins-hbase4.apache.org/45213] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-09-19 20:03:35,335 WARN [Listener at jenkins-hbase4.apache.org/45213] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-19 20:03:35,338 INFO [Listener at jenkins-hbase4.apache.org/45213] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-19 20:03:35,440 WARN [BP-1994955438-172.31.14.131-1695153667733 heartbeating to localhost/127.0.0.1:38739] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-19 20:03:35,440 WARN [BP-1994955438-172.31.14.131-1695153667733 heartbeating to localhost/127.0.0.1:38739] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1994955438-172.31.14.131-1695153667733 (Datanode Uuid 0c004ae8-c20b-4b37-8525-5530d9cc8978) service to localhost/127.0.0.1:38739 2023-09-19 20:03:35,442 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59/cluster_89d21045-e502-a291-a4eb-07ce7438eb28/dfs/data/data5/current/BP-1994955438-172.31.14.131-1695153667733] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-19 20:03:35,443 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59/cluster_89d21045-e502-a291-a4eb-07ce7438eb28/dfs/data/data6/current/BP-1994955438-172.31.14.131-1695153667733] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-19 20:03:35,444 WARN [Listener at jenkins-hbase4.apache.org/45213] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-19 20:03:35,445 INFO [Listener at jenkins-hbase4.apache.org/45213] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-19 20:03:35,548 WARN [BP-1994955438-172.31.14.131-1695153667733 heartbeating to localhost/127.0.0.1:38739] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-19 20:03:35,548 WARN [BP-1994955438-172.31.14.131-1695153667733 heartbeating to localhost/127.0.0.1:38739] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1994955438-172.31.14.131-1695153667733 (Datanode Uuid d7d864b1-2401-4e90-9a0e-ab3af3d8c6f1) service to localhost/127.0.0.1:38739 2023-09-19 20:03:35,549 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59/cluster_89d21045-e502-a291-a4eb-07ce7438eb28/dfs/data/data3/current/BP-1994955438-172.31.14.131-1695153667733] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-19 20:03:35,549 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59/cluster_89d21045-e502-a291-a4eb-07ce7438eb28/dfs/data/data4/current/BP-1994955438-172.31.14.131-1695153667733] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-19 20:03:35,550 WARN [Listener at jenkins-hbase4.apache.org/45213] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-19 20:03:35,552 INFO [Listener at jenkins-hbase4.apache.org/45213] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-19 20:03:35,654 WARN [BP-1994955438-172.31.14.131-1695153667733 heartbeating to localhost/127.0.0.1:38739] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-19 20:03:35,654 WARN [BP-1994955438-172.31.14.131-1695153667733 heartbeating to localhost/127.0.0.1:38739] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1994955438-172.31.14.131-1695153667733 (Datanode Uuid 604c5182-fbdd-4326-8b53-d13180e22499) service to localhost/127.0.0.1:38739 2023-09-19 20:03:35,655 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59/cluster_89d21045-e502-a291-a4eb-07ce7438eb28/dfs/data/data1/current/BP-1994955438-172.31.14.131-1695153667733] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-19 20:03:35,655 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9d88384-1b0e-43ea-11a6-900d87a86e59/cluster_89d21045-e502-a291-a4eb-07ce7438eb28/dfs/data/data2/current/BP-1994955438-172.31.14.131-1695153667733] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-19 20:03:35,679 INFO [Listener at jenkins-hbase4.apache.org/45213] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-19 20:03:35,804 INFO [Listener at jenkins-hbase4.apache.org/45213] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-09-19 20:03:35,903 INFO [Listener at jenkins-hbase4.apache.org/45213] hbase.HBaseTestingUtility(1293): Minicluster is down