2023-07-18 10:10:20,406 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-18 10:10:20,640 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c329d283-1f43-4a99-3860-7ed90b9830ca 2023-07-18 10:10:20,640 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-07-18 10:10:20,640 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-07-18 10:10:20,683 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-18 10:10:20,937 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-18 10:10:20,938 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c329d283-1f43-4a99-3860-7ed90b9830ca/cluster_838469a3-f099-4817-4d19-bba87533c742, deleteOnExit=true 2023-07-18 10:10:20,938 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-18 10:10:20,939 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c329d283-1f43-4a99-3860-7ed90b9830ca/test.cache.data in system properties and HBase conf 2023-07-18 10:10:20,940 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c329d283-1f43-4a99-3860-7ed90b9830ca/hadoop.tmp.dir in system properties and HBase conf 2023-07-18 10:10:20,940 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c329d283-1f43-4a99-3860-7ed90b9830ca/hadoop.log.dir in system properties and HBase conf 2023-07-18 10:10:20,941 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c329d283-1f43-4a99-3860-7ed90b9830ca/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-18 10:10:20,941 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c329d283-1f43-4a99-3860-7ed90b9830ca/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-18 10:10:20,942 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-18 10:10:21,333 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-18 10:10:21,339 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c329d283-1f43-4a99-3860-7ed90b9830ca/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-18 10:10:21,340 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c329d283-1f43-4a99-3860-7ed90b9830ca/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-18 10:10:21,340 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c329d283-1f43-4a99-3860-7ed90b9830ca/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-18 10:10:21,340 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c329d283-1f43-4a99-3860-7ed90b9830ca/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-18 10:10:21,341 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c329d283-1f43-4a99-3860-7ed90b9830ca/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-18 10:10:21,341 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c329d283-1f43-4a99-3860-7ed90b9830ca/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-18 10:10:21,342 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c329d283-1f43-4a99-3860-7ed90b9830ca/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-18 10:10:21,342 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c329d283-1f43-4a99-3860-7ed90b9830ca/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-18 10:10:21,343 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c329d283-1f43-4a99-3860-7ed90b9830ca/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-18 10:10:21,343 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c329d283-1f43-4a99-3860-7ed90b9830ca/nfs.dump.dir in system properties and HBase conf 2023-07-18 10:10:21,344 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c329d283-1f43-4a99-3860-7ed90b9830ca/java.io.tmpdir in system properties and HBase conf 2023-07-18 10:10:21,344 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c329d283-1f43-4a99-3860-7ed90b9830ca/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-18 10:10:21,344 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c329d283-1f43-4a99-3860-7ed90b9830ca/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-18 10:10:21,345 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c329d283-1f43-4a99-3860-7ed90b9830ca/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-18 10:10:22,007 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-18 10:10:22,011 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-18 10:10:22,283 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-18 10:10:22,473 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-18 10:10:22,488 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-18 10:10:22,530 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-18 10:10:22,562 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c329d283-1f43-4a99-3860-7ed90b9830ca/java.io.tmpdir/Jetty_localhost_44659_hdfs____fow2v8/webapp 2023-07-18 10:10:22,709 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44659 2023-07-18 10:10:22,744 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-18 10:10:22,745 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-18 10:10:23,283 WARN [Listener at localhost/44811] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-18 10:10:23,384 WARN [Listener at localhost/44811] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-18 10:10:23,410 WARN [Listener at localhost/44811] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-18 10:10:23,418 INFO [Listener at localhost/44811] log.Slf4jLog(67): jetty-6.1.26 2023-07-18 10:10:23,424 INFO [Listener at localhost/44811] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c329d283-1f43-4a99-3860-7ed90b9830ca/java.io.tmpdir/Jetty_localhost_34529_datanode____l93jc2/webapp 2023-07-18 10:10:23,606 INFO [Listener at localhost/44811] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34529 2023-07-18 10:10:24,126 WARN [Listener at localhost/37995] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-18 10:10:24,165 WARN [Listener at localhost/37995] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-18 10:10:24,170 WARN [Listener at localhost/37995] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-18 10:10:24,172 INFO [Listener at localhost/37995] log.Slf4jLog(67): jetty-6.1.26 2023-07-18 10:10:24,179 INFO [Listener at localhost/37995] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c329d283-1f43-4a99-3860-7ed90b9830ca/java.io.tmpdir/Jetty_localhost_41789_datanode____.2d9ygu/webapp 2023-07-18 10:10:24,311 INFO [Listener at localhost/37995] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41789 2023-07-18 10:10:24,328 WARN [Listener at localhost/32785] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-18 10:10:24,363 WARN [Listener at localhost/32785] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-18 10:10:24,374 WARN [Listener at localhost/32785] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-18 10:10:24,376 INFO [Listener at localhost/32785] log.Slf4jLog(67): jetty-6.1.26 2023-07-18 10:10:24,385 INFO [Listener at localhost/32785] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c329d283-1f43-4a99-3860-7ed90b9830ca/java.io.tmpdir/Jetty_localhost_37493_datanode____clwpch/webapp 2023-07-18 10:10:24,532 INFO [Listener at localhost/32785] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37493 2023-07-18 10:10:24,556 WARN [Listener at localhost/33477] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-18 10:10:24,833 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc9052bf5aae64118: Processing first storage report for DS-5ec3be7b-5664-4467-9753-5eb2ed3326e5 from datanode 18112d50-df5d-414d-a342-3305eb50303d 2023-07-18 10:10:24,835 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc9052bf5aae64118: from storage DS-5ec3be7b-5664-4467-9753-5eb2ed3326e5 node DatanodeRegistration(127.0.0.1:36009, datanodeUuid=18112d50-df5d-414d-a342-3305eb50303d, infoPort=38915, infoSecurePort=0, ipcPort=37995, storageInfo=lv=-57;cid=testClusterID;nsid=852673285;c=1689675022078), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-07-18 10:10:24,835 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x2d5f07458b54204: Processing first storage report for DS-7ddfeaca-9266-438b-8921-55c4dc71227d from datanode 7469db32-c65d-4c3d-90c0-ff2000ea9037 2023-07-18 10:10:24,835 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x2d5f07458b54204: from storage DS-7ddfeaca-9266-438b-8921-55c4dc71227d node DatanodeRegistration(127.0.0.1:39715, datanodeUuid=7469db32-c65d-4c3d-90c0-ff2000ea9037, infoPort=38503, infoSecurePort=0, ipcPort=32785, storageInfo=lv=-57;cid=testClusterID;nsid=852673285;c=1689675022078), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-18 10:10:24,835 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x71b359fc4c106b7f: Processing first storage report for DS-d5ea5d57-261e-42e7-8930-9b2f278e5fbb from datanode 4ea6fd35-36a3-4881-8109-11ae1d968b65 2023-07-18 10:10:24,835 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x71b359fc4c106b7f: from storage DS-d5ea5d57-261e-42e7-8930-9b2f278e5fbb node DatanodeRegistration(127.0.0.1:38469, datanodeUuid=4ea6fd35-36a3-4881-8109-11ae1d968b65, infoPort=41251, infoSecurePort=0, ipcPort=33477, storageInfo=lv=-57;cid=testClusterID;nsid=852673285;c=1689675022078), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-18 10:10:24,835 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc9052bf5aae64118: Processing first storage report for DS-c468c459-fa9d-4b45-812b-24ef1f9f120d from datanode 18112d50-df5d-414d-a342-3305eb50303d 2023-07-18 10:10:24,836 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc9052bf5aae64118: from storage DS-c468c459-fa9d-4b45-812b-24ef1f9f120d node DatanodeRegistration(127.0.0.1:36009, datanodeUuid=18112d50-df5d-414d-a342-3305eb50303d, infoPort=38915, infoSecurePort=0, ipcPort=37995, storageInfo=lv=-57;cid=testClusterID;nsid=852673285;c=1689675022078), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-18 10:10:24,836 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x2d5f07458b54204: Processing first storage report for DS-ff8ae320-c631-4af0-904c-021eb6a1a498 from datanode 7469db32-c65d-4c3d-90c0-ff2000ea9037 2023-07-18 10:10:24,836 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x2d5f07458b54204: from storage DS-ff8ae320-c631-4af0-904c-021eb6a1a498 node DatanodeRegistration(127.0.0.1:39715, datanodeUuid=7469db32-c65d-4c3d-90c0-ff2000ea9037, infoPort=38503, infoSecurePort=0, ipcPort=32785, storageInfo=lv=-57;cid=testClusterID;nsid=852673285;c=1689675022078), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-18 10:10:24,836 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x71b359fc4c106b7f: Processing first storage report for DS-acb572b8-5eaf-42b3-b6e3-31bb78ba96e6 from datanode 4ea6fd35-36a3-4881-8109-11ae1d968b65 2023-07-18 10:10:24,836 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x71b359fc4c106b7f: from storage DS-acb572b8-5eaf-42b3-b6e3-31bb78ba96e6 node DatanodeRegistration(127.0.0.1:38469, datanodeUuid=4ea6fd35-36a3-4881-8109-11ae1d968b65, infoPort=41251, infoSecurePort=0, ipcPort=33477, storageInfo=lv=-57;cid=testClusterID;nsid=852673285;c=1689675022078), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-18 10:10:25,047 DEBUG [Listener at localhost/33477] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c329d283-1f43-4a99-3860-7ed90b9830ca 2023-07-18 10:10:25,128 INFO [Listener at localhost/33477] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c329d283-1f43-4a99-3860-7ed90b9830ca/cluster_838469a3-f099-4817-4d19-bba87533c742/zookeeper_0, clientPort=60990, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c329d283-1f43-4a99-3860-7ed90b9830ca/cluster_838469a3-f099-4817-4d19-bba87533c742/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c329d283-1f43-4a99-3860-7ed90b9830ca/cluster_838469a3-f099-4817-4d19-bba87533c742/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-18 10:10:25,149 INFO [Listener at localhost/33477] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=60990 2023-07-18 10:10:25,161 INFO [Listener at localhost/33477] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 10:10:25,164 INFO [Listener at localhost/33477] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 10:10:25,869 INFO [Listener at localhost/33477] util.FSUtils(471): Created version file at hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427 with version=8 2023-07-18 10:10:25,869 INFO [Listener at localhost/33477] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/hbase-staging 2023-07-18 10:10:26,277 INFO [Listener at localhost/33477] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-18 10:10:26,882 INFO [Listener at localhost/33477] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-07-18 10:10:26,923 INFO [Listener at localhost/33477] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-18 10:10:26,923 INFO [Listener at localhost/33477] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-18 10:10:26,924 INFO [Listener at localhost/33477] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-18 10:10:26,924 INFO [Listener at localhost/33477] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-18 10:10:26,924 INFO [Listener at localhost/33477] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-18 10:10:27,092 INFO [Listener at localhost/33477] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-18 10:10:27,173 DEBUG [Listener at localhost/33477] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-18 10:10:27,292 INFO [Listener at localhost/33477] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38235 2023-07-18 10:10:27,306 INFO [Listener at localhost/33477] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 10:10:27,308 INFO [Listener at localhost/33477] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 10:10:27,332 INFO [Listener at localhost/33477] zookeeper.RecoverableZooKeeper(93): Process identifier=master:38235 connecting to ZooKeeper ensemble=127.0.0.1:60990 2023-07-18 10:10:27,388 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:382350x0, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-18 10:10:27,392 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:38235-0x10177e94dd40000 connected 2023-07-18 10:10:27,432 DEBUG [Listener at localhost/33477] zookeeper.ZKUtil(164): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-18 10:10:27,433 DEBUG [Listener at localhost/33477] zookeeper.ZKUtil(164): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-18 10:10:27,451 DEBUG [Listener at localhost/33477] zookeeper.ZKUtil(164): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-18 10:10:27,462 DEBUG [Listener at localhost/33477] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38235 2023-07-18 10:10:27,463 DEBUG [Listener at localhost/33477] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38235 2023-07-18 10:10:27,464 DEBUG [Listener at localhost/33477] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38235 2023-07-18 10:10:27,467 DEBUG [Listener at localhost/33477] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38235 2023-07-18 10:10:27,468 DEBUG [Listener at localhost/33477] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38235 2023-07-18 10:10:27,475 INFO [Listener at localhost/33477] master.HMaster(444): hbase.rootdir=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427, hbase.cluster.distributed=false 2023-07-18 10:10:27,546 INFO [Listener at localhost/33477] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-18 10:10:27,547 INFO [Listener at localhost/33477] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-18 10:10:27,547 INFO [Listener at localhost/33477] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-18 10:10:27,547 INFO [Listener at localhost/33477] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-18 10:10:27,547 INFO [Listener at localhost/33477] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-18 10:10:27,547 INFO [Listener at localhost/33477] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-18 10:10:27,552 INFO [Listener at localhost/33477] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-18 10:10:27,555 INFO [Listener at localhost/33477] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37417 2023-07-18 10:10:27,558 INFO [Listener at localhost/33477] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-18 10:10:27,573 INFO [Listener at localhost/33477] mob.MobFileCache(124): MobFileCache disabled 2023-07-18 10:10:27,574 INFO [Listener at localhost/33477] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 10:10:27,576 INFO [Listener at localhost/33477] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 10:10:27,578 INFO [Listener at localhost/33477] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:37417 connecting to ZooKeeper ensemble=127.0.0.1:60990 2023-07-18 10:10:27,586 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:374170x0, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-18 10:10:27,587 DEBUG [Listener at localhost/33477] zookeeper.ZKUtil(164): regionserver:374170x0, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-18 10:10:27,588 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:37417-0x10177e94dd40001 connected 2023-07-18 10:10:27,589 DEBUG [Listener at localhost/33477] zookeeper.ZKUtil(164): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-18 10:10:27,590 DEBUG [Listener at localhost/33477] zookeeper.ZKUtil(164): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-18 10:10:27,598 DEBUG [Listener at localhost/33477] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37417 2023-07-18 10:10:27,599 DEBUG [Listener at localhost/33477] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37417 2023-07-18 10:10:27,599 DEBUG [Listener at localhost/33477] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37417 2023-07-18 10:10:27,601 DEBUG [Listener at localhost/33477] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37417 2023-07-18 10:10:27,601 DEBUG [Listener at localhost/33477] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37417 2023-07-18 10:10:27,618 INFO [Listener at localhost/33477] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-18 10:10:27,618 INFO [Listener at localhost/33477] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-18 10:10:27,618 INFO [Listener at localhost/33477] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-18 10:10:27,619 INFO [Listener at localhost/33477] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-18 10:10:27,619 INFO [Listener at localhost/33477] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-18 10:10:27,620 INFO [Listener at localhost/33477] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-18 10:10:27,620 INFO [Listener at localhost/33477] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-18 10:10:27,622 INFO [Listener at localhost/33477] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39709 2023-07-18 10:10:27,622 INFO [Listener at localhost/33477] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-18 10:10:27,629 INFO [Listener at localhost/33477] mob.MobFileCache(124): MobFileCache disabled 2023-07-18 10:10:27,631 INFO [Listener at localhost/33477] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 10:10:27,639 INFO [Listener at localhost/33477] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 10:10:27,642 INFO [Listener at localhost/33477] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:39709 connecting to ZooKeeper ensemble=127.0.0.1:60990 2023-07-18 10:10:27,649 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:397090x0, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-18 10:10:27,650 DEBUG [Listener at localhost/33477] zookeeper.ZKUtil(164): regionserver:397090x0, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-18 10:10:27,651 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:39709-0x10177e94dd40002 connected 2023-07-18 10:10:27,651 DEBUG [Listener at localhost/33477] zookeeper.ZKUtil(164): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-18 10:10:27,652 DEBUG [Listener at localhost/33477] zookeeper.ZKUtil(164): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-18 10:10:27,653 DEBUG [Listener at localhost/33477] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39709 2023-07-18 10:10:27,654 DEBUG [Listener at localhost/33477] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39709 2023-07-18 10:10:27,654 DEBUG [Listener at localhost/33477] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39709 2023-07-18 10:10:27,658 DEBUG [Listener at localhost/33477] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39709 2023-07-18 10:10:27,658 DEBUG [Listener at localhost/33477] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39709 2023-07-18 10:10:27,671 INFO [Listener at localhost/33477] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-18 10:10:27,671 INFO [Listener at localhost/33477] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-18 10:10:27,671 INFO [Listener at localhost/33477] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-18 10:10:27,671 INFO [Listener at localhost/33477] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-18 10:10:27,671 INFO [Listener at localhost/33477] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-18 10:10:27,671 INFO [Listener at localhost/33477] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-18 10:10:27,672 INFO [Listener at localhost/33477] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-18 10:10:27,675 INFO [Listener at localhost/33477] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43301 2023-07-18 10:10:27,675 INFO [Listener at localhost/33477] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-18 10:10:27,676 INFO [Listener at localhost/33477] mob.MobFileCache(124): MobFileCache disabled 2023-07-18 10:10:27,677 INFO [Listener at localhost/33477] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 10:10:27,678 INFO [Listener at localhost/33477] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 10:10:27,680 INFO [Listener at localhost/33477] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43301 connecting to ZooKeeper ensemble=127.0.0.1:60990 2023-07-18 10:10:27,686 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:433010x0, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-18 10:10:27,687 DEBUG [Listener at localhost/33477] zookeeper.ZKUtil(164): regionserver:433010x0, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-18 10:10:27,687 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:43301-0x10177e94dd40003 connected 2023-07-18 10:10:27,688 DEBUG [Listener at localhost/33477] zookeeper.ZKUtil(164): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-18 10:10:27,689 DEBUG [Listener at localhost/33477] zookeeper.ZKUtil(164): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-18 10:10:27,691 DEBUG [Listener at localhost/33477] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43301 2023-07-18 10:10:27,692 DEBUG [Listener at localhost/33477] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43301 2023-07-18 10:10:27,694 DEBUG [Listener at localhost/33477] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43301 2023-07-18 10:10:27,699 DEBUG [Listener at localhost/33477] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43301 2023-07-18 10:10:27,702 DEBUG [Listener at localhost/33477] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43301 2023-07-18 10:10:27,707 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,38235,1689675026088 2023-07-18 10:10:27,717 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-18 10:10:27,718 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,38235,1689675026088 2023-07-18 10:10:27,739 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-18 10:10:27,740 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-18 10:10:27,739 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-18 10:10:27,740 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-18 10:10:27,741 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 10:10:27,744 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-18 10:10:27,744 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-18 10:10:27,746 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,38235,1689675026088 from backup master directory 2023-07-18 10:10:27,753 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,38235,1689675026088 2023-07-18 10:10:27,753 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-18 10:10:27,754 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-18 10:10:27,754 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,38235,1689675026088 2023-07-18 10:10:27,757 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-18 10:10:27,758 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-18 10:10:27,873 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/hbase.id with ID: dd076f66-84b7-41a4-892d-be8d87f86627 2023-07-18 10:10:27,922 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 10:10:27,943 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 10:10:28,023 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x2cdbbc26 to 127.0.0.1:60990 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 10:10:28,069 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6fc8ccf2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 10:10:28,101 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-18 10:10:28,103 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-18 10:10:28,123 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-18 10:10:28,123 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-18 10:10:28,125 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-18 10:10:28,130 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-18 10:10:28,131 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-18 10:10:28,183 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/MasterData/data/master/store-tmp 2023-07-18 10:10:28,256 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 10:10:28,257 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-18 10:10:28,257 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-18 10:10:28,257 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-18 10:10:28,257 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-18 10:10:28,257 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-18 10:10:28,257 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-18 10:10:28,257 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-18 10:10:28,259 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/MasterData/WALs/jenkins-hbase4.apache.org,38235,1689675026088 2023-07-18 10:10:28,290 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38235%2C1689675026088, suffix=, logDir=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/MasterData/WALs/jenkins-hbase4.apache.org,38235,1689675026088, archiveDir=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/MasterData/oldWALs, maxLogs=10 2023-07-18 10:10:28,375 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36009,DS-5ec3be7b-5664-4467-9753-5eb2ed3326e5,DISK] 2023-07-18 10:10:28,375 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39715,DS-7ddfeaca-9266-438b-8921-55c4dc71227d,DISK] 2023-07-18 10:10:28,375 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38469,DS-d5ea5d57-261e-42e7-8930-9b2f278e5fbb,DISK] 2023-07-18 10:10:28,387 DEBUG [RS-EventLoopGroup-5-1] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-18 10:10:28,513 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/MasterData/WALs/jenkins-hbase4.apache.org,38235,1689675026088/jenkins-hbase4.apache.org%2C38235%2C1689675026088.1689675028305 2023-07-18 10:10:28,515 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36009,DS-5ec3be7b-5664-4467-9753-5eb2ed3326e5,DISK], DatanodeInfoWithStorage[127.0.0.1:38469,DS-d5ea5d57-261e-42e7-8930-9b2f278e5fbb,DISK], DatanodeInfoWithStorage[127.0.0.1:39715,DS-7ddfeaca-9266-438b-8921-55c4dc71227d,DISK]] 2023-07-18 10:10:28,515 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-18 10:10:28,516 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 10:10:28,520 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-18 10:10:28,522 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-18 10:10:28,611 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-18 10:10:28,619 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-18 10:10:28,661 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-18 10:10:28,673 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 10:10:28,680 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-18 10:10:28,682 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-18 10:10:28,701 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-18 10:10:28,708 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 10:10:28,709 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73503215, jitterRate=0.09528325498104095}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 10:10:28,709 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-18 10:10:28,712 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-18 10:10:28,742 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-18 10:10:28,742 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-18 10:10:28,746 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-18 10:10:28,748 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-18 10:10:28,791 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 42 msec 2023-07-18 10:10:28,792 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-18 10:10:28,825 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-18 10:10:28,832 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-18 10:10:28,859 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-18 10:10:28,865 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-18 10:10:28,867 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-18 10:10:28,873 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-18 10:10:28,877 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-18 10:10:28,881 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 10:10:28,884 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-18 10:10:28,884 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-18 10:10:28,901 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-18 10:10:28,909 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-18 10:10:28,909 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-18 10:10:28,909 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-18 10:10:28,910 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-18 10:10:28,910 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 10:10:28,914 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,38235,1689675026088, sessionid=0x10177e94dd40000, setting cluster-up flag (Was=false) 2023-07-18 10:10:28,938 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 10:10:28,945 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-18 10:10:28,947 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,38235,1689675026088 2023-07-18 10:10:28,957 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 10:10:28,964 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-18 10:10:28,968 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,38235,1689675026088 2023-07-18 10:10:28,971 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/.tmp 2023-07-18 10:10:29,008 INFO [RS:2;jenkins-hbase4:43301] regionserver.HRegionServer(951): ClusterId : dd076f66-84b7-41a4-892d-be8d87f86627 2023-07-18 10:10:29,008 INFO [RS:0;jenkins-hbase4:37417] regionserver.HRegionServer(951): ClusterId : dd076f66-84b7-41a4-892d-be8d87f86627 2023-07-18 10:10:29,010 INFO [RS:1;jenkins-hbase4:39709] regionserver.HRegionServer(951): ClusterId : dd076f66-84b7-41a4-892d-be8d87f86627 2023-07-18 10:10:29,017 DEBUG [RS:0;jenkins-hbase4:37417] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-18 10:10:29,017 DEBUG [RS:1;jenkins-hbase4:39709] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-18 10:10:29,017 DEBUG [RS:2;jenkins-hbase4:43301] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-18 10:10:29,026 DEBUG [RS:2;jenkins-hbase4:43301] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-18 10:10:29,026 DEBUG [RS:0;jenkins-hbase4:37417] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-18 10:10:29,026 DEBUG [RS:1;jenkins-hbase4:39709] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-18 10:10:29,026 DEBUG [RS:2;jenkins-hbase4:43301] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-18 10:10:29,026 DEBUG [RS:0;jenkins-hbase4:37417] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-18 10:10:29,026 DEBUG [RS:1;jenkins-hbase4:39709] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-18 10:10:29,041 DEBUG [RS:2;jenkins-hbase4:43301] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-18 10:10:29,041 DEBUG [RS:1;jenkins-hbase4:39709] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-18 10:10:29,044 DEBUG [RS:2;jenkins-hbase4:43301] zookeeper.ReadOnlyZKClient(139): Connect 0x250ee95f to 127.0.0.1:60990 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 10:10:29,052 DEBUG [RS:1;jenkins-hbase4:39709] zookeeper.ReadOnlyZKClient(139): Connect 0x686d5526 to 127.0.0.1:60990 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 10:10:29,060 DEBUG [RS:0;jenkins-hbase4:37417] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-18 10:10:29,069 DEBUG [RS:0;jenkins-hbase4:37417] zookeeper.ReadOnlyZKClient(139): Connect 0x31dff6bb to 127.0.0.1:60990 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 10:10:29,138 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-18 10:10:29,144 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 10:10:29,144 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-18 10:10:29,155 DEBUG [RS:2;jenkins-hbase4:43301] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@39c55f20, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 10:10:29,156 DEBUG [RS:2;jenkins-hbase4:43301] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5d265f5c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-18 10:10:29,157 DEBUG [RS:1;jenkins-hbase4:39709] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@66aab65b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 10:10:29,157 DEBUG [RS:1;jenkins-hbase4:39709] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@62953e56, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-18 10:10:29,159 DEBUG [RS:0;jenkins-hbase4:37417] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2a99916c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 10:10:29,161 DEBUG [RS:0;jenkins-hbase4:37417] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1e4de134, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-18 10:10:29,189 DEBUG [RS:2;jenkins-hbase4:43301] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:43301 2023-07-18 10:10:29,189 DEBUG [RS:1;jenkins-hbase4:39709] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:39709 2023-07-18 10:10:29,191 DEBUG [RS:0;jenkins-hbase4:37417] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:37417 2023-07-18 10:10:29,196 INFO [RS:1;jenkins-hbase4:39709] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-18 10:10:29,197 INFO [RS:0;jenkins-hbase4:37417] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-18 10:10:29,196 INFO [RS:2;jenkins-hbase4:43301] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-18 10:10:29,197 INFO [RS:0;jenkins-hbase4:37417] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-18 10:10:29,197 INFO [RS:1;jenkins-hbase4:39709] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-18 10:10:29,197 INFO [RS:2;jenkins-hbase4:43301] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-18 10:10:29,197 DEBUG [RS:1;jenkins-hbase4:39709] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-18 10:10:29,197 DEBUG [RS:0;jenkins-hbase4:37417] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-18 10:10:29,197 DEBUG [RS:2;jenkins-hbase4:43301] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-18 10:10:29,198 INFO [RS:1;jenkins-hbase4:39709] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 10:10:29,198 INFO [RS:0;jenkins-hbase4:37417] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 10:10:29,198 INFO [RS:2;jenkins-hbase4:43301] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 10:10:29,199 DEBUG [RS:2;jenkins-hbase4:43301] regionserver.HRegionServer(1022): About to register with Master. 2023-07-18 10:10:29,198 DEBUG [RS:1;jenkins-hbase4:39709] regionserver.HRegionServer(1022): About to register with Master. 2023-07-18 10:10:29,198 DEBUG [RS:0;jenkins-hbase4:37417] regionserver.HRegionServer(1022): About to register with Master. 2023-07-18 10:10:29,202 INFO [RS:2;jenkins-hbase4:43301] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,38235,1689675026088 with isa=jenkins-hbase4.apache.org/172.31.14.131:43301, startcode=1689675027670 2023-07-18 10:10:29,202 INFO [RS:1;jenkins-hbase4:39709] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,38235,1689675026088 with isa=jenkins-hbase4.apache.org/172.31.14.131:39709, startcode=1689675027617 2023-07-18 10:10:29,202 INFO [RS:0;jenkins-hbase4:37417] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,38235,1689675026088 with isa=jenkins-hbase4.apache.org/172.31.14.131:37417, startcode=1689675027545 2023-07-18 10:10:29,224 DEBUG [RS:1;jenkins-hbase4:39709] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-18 10:10:29,224 DEBUG [RS:0;jenkins-hbase4:37417] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-18 10:10:29,231 DEBUG [RS:2;jenkins-hbase4:43301] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-18 10:10:29,261 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-18 10:10:29,277 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-18 10:10:29,277 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-18 10:10:29,277 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-18 10:10:29,277 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-18 10:10:29,277 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-18 10:10:29,277 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 10:10:29,278 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-18 10:10:29,278 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 10:10:29,297 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689675059296 2023-07-18 10:10:29,300 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-18 10:10:29,305 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-18 10:10:29,306 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-18 10:10:29,309 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37097, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-18 10:10:29,309 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38659, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-18 10:10:29,319 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43803, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-18 10:10:29,319 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-18 10:10:29,320 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38235] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-18 10:10:29,321 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-18 10:10:29,331 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-18 10:10:29,332 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38235] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-18 10:10:29,332 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-18 10:10:29,335 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38235] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-18 10:10:29,336 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-18 10:10:29,336 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-18 10:10:29,337 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-18 10:10:29,343 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-18 10:10:29,346 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-18 10:10:29,346 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-18 10:10:29,360 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-18 10:10:29,361 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-18 10:10:29,368 DEBUG [RS:2;jenkins-hbase4:43301] regionserver.HRegionServer(2830): Master is not running yet 2023-07-18 10:10:29,369 WARN [RS:2;jenkins-hbase4:43301] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-18 10:10:29,368 DEBUG [RS:1;jenkins-hbase4:39709] regionserver.HRegionServer(2830): Master is not running yet 2023-07-18 10:10:29,371 WARN [RS:1;jenkins-hbase4:39709] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-18 10:10:29,368 DEBUG [RS:0;jenkins-hbase4:37417] regionserver.HRegionServer(2830): Master is not running yet 2023-07-18 10:10:29,369 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689675029367,5,FailOnTimeoutGroup] 2023-07-18 10:10:29,372 WARN [RS:0;jenkins-hbase4:37417] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-18 10:10:29,374 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689675029372,5,FailOnTimeoutGroup] 2023-07-18 10:10:29,375 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-18 10:10:29,375 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-18 10:10:29,376 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-18 10:10:29,377 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-18 10:10:29,414 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-18 10:10:29,415 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-18 10:10:29,416 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427 2023-07-18 10:10:29,461 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 10:10:29,467 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-18 10:10:29,470 INFO [RS:2;jenkins-hbase4:43301] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,38235,1689675026088 with isa=jenkins-hbase4.apache.org/172.31.14.131:43301, startcode=1689675027670 2023-07-18 10:10:29,471 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/hbase/meta/1588230740/info 2023-07-18 10:10:29,474 INFO [RS:1;jenkins-hbase4:39709] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,38235,1689675026088 with isa=jenkins-hbase4.apache.org/172.31.14.131:39709, startcode=1689675027617 2023-07-18 10:10:29,474 INFO [RS:0;jenkins-hbase4:37417] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,38235,1689675026088 with isa=jenkins-hbase4.apache.org/172.31.14.131:37417, startcode=1689675027545 2023-07-18 10:10:29,474 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-18 10:10:29,478 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38235] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:29,478 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 10:10:29,479 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-18 10:10:29,483 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/hbase/meta/1588230740/rep_barrier 2023-07-18 10:10:29,484 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38235] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:10:29,484 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-18 10:10:29,485 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38235] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:10:29,486 DEBUG [RS:1;jenkins-hbase4:39709] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427 2023-07-18 10:10:29,486 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 10:10:29,487 DEBUG [RS:2;jenkins-hbase4:43301] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427 2023-07-18 10:10:29,487 DEBUG [RS:1;jenkins-hbase4:39709] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:44811 2023-07-18 10:10:29,487 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-18 10:10:29,487 DEBUG [RS:2;jenkins-hbase4:43301] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:44811 2023-07-18 10:10:29,488 DEBUG [RS:2;jenkins-hbase4:43301] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-18 10:10:29,487 DEBUG [RS:1;jenkins-hbase4:39709] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-18 10:10:29,488 DEBUG [RS:0;jenkins-hbase4:37417] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427 2023-07-18 10:10:29,488 DEBUG [RS:0;jenkins-hbase4:37417] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:44811 2023-07-18 10:10:29,488 DEBUG [RS:0;jenkins-hbase4:37417] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-18 10:10:29,491 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/hbase/meta/1588230740/table 2023-07-18 10:10:29,491 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-18 10:10:29,492 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 10:10:29,495 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/hbase/meta/1588230740 2023-07-18 10:10:29,496 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/hbase/meta/1588230740 2023-07-18 10:10:29,497 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-18 10:10:29,499 DEBUG [RS:2;jenkins-hbase4:43301] zookeeper.ZKUtil(162): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:29,499 DEBUG [RS:0;jenkins-hbase4:37417] zookeeper.ZKUtil(162): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:10:29,499 WARN [RS:2;jenkins-hbase4:43301] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-18 10:10:29,499 DEBUG [RS:1;jenkins-hbase4:39709] zookeeper.ZKUtil(162): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:10:29,499 INFO [RS:2;jenkins-hbase4:43301] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-18 10:10:29,500 DEBUG [RS:2;jenkins-hbase4:43301] regionserver.HRegionServer(1948): logDir=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/WALs/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:29,502 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-18 10:10:29,507 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-18 10:10:29,499 WARN [RS:0;jenkins-hbase4:37417] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-18 10:10:29,499 WARN [RS:1;jenkins-hbase4:39709] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-18 10:10:29,513 INFO [RS:0;jenkins-hbase4:37417] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-18 10:10:29,519 DEBUG [RS:0;jenkins-hbase4:37417] regionserver.HRegionServer(1948): logDir=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/WALs/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:10:29,514 INFO [RS:1;jenkins-hbase4:39709] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-18 10:10:29,520 DEBUG [RS:1;jenkins-hbase4:39709] regionserver.HRegionServer(1948): logDir=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/WALs/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:10:29,520 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,37417,1689675027545] 2023-07-18 10:10:29,520 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,39709,1689675027617] 2023-07-18 10:10:29,520 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,43301,1689675027670] 2023-07-18 10:10:29,534 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 10:10:29,544 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73609308, jitterRate=0.09686416387557983}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-18 10:10:29,544 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-18 10:10:29,545 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-18 10:10:29,545 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-18 10:10:29,545 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-18 10:10:29,545 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-18 10:10:29,545 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-18 10:10:29,555 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-18 10:10:29,556 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-18 10:10:29,565 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-18 10:10:29,565 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-18 10:10:29,565 DEBUG [RS:1;jenkins-hbase4:39709] zookeeper.ZKUtil(162): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:10:29,565 DEBUG [RS:2;jenkins-hbase4:43301] zookeeper.ZKUtil(162): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:10:29,569 DEBUG [RS:0;jenkins-hbase4:37417] zookeeper.ZKUtil(162): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:10:29,569 DEBUG [RS:1;jenkins-hbase4:39709] zookeeper.ZKUtil(162): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:10:29,570 DEBUG [RS:0;jenkins-hbase4:37417] zookeeper.ZKUtil(162): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:10:29,574 DEBUG [RS:2;jenkins-hbase4:43301] zookeeper.ZKUtil(162): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:10:29,575 DEBUG [RS:1;jenkins-hbase4:39709] zookeeper.ZKUtil(162): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:29,575 DEBUG [RS:0;jenkins-hbase4:37417] zookeeper.ZKUtil(162): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:29,576 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-18 10:10:29,586 DEBUG [RS:2;jenkins-hbase4:43301] zookeeper.ZKUtil(162): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:29,589 DEBUG [RS:1;jenkins-hbase4:39709] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-18 10:10:29,589 DEBUG [RS:2;jenkins-hbase4:43301] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-18 10:10:29,590 DEBUG [RS:0;jenkins-hbase4:37417] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-18 10:10:29,596 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-18 10:10:29,603 INFO [RS:1;jenkins-hbase4:39709] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-18 10:10:29,603 INFO [RS:2;jenkins-hbase4:43301] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-18 10:10:29,604 INFO [RS:0;jenkins-hbase4:37417] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-18 10:10:29,606 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-18 10:10:29,633 INFO [RS:1;jenkins-hbase4:39709] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-18 10:10:29,635 INFO [RS:0;jenkins-hbase4:37417] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-18 10:10:29,635 INFO [RS:2;jenkins-hbase4:43301] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-18 10:10:29,638 INFO [RS:0;jenkins-hbase4:37417] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-18 10:10:29,639 INFO [RS:0;jenkins-hbase4:37417] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-18 10:10:29,638 INFO [RS:1;jenkins-hbase4:39709] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-18 10:10:29,643 INFO [RS:1;jenkins-hbase4:39709] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-18 10:10:29,644 INFO [RS:0;jenkins-hbase4:37417] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-18 10:10:29,646 INFO [RS:1;jenkins-hbase4:39709] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-18 10:10:29,648 INFO [RS:2;jenkins-hbase4:43301] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-18 10:10:29,648 INFO [RS:2;jenkins-hbase4:43301] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-18 10:10:29,650 INFO [RS:2;jenkins-hbase4:43301] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-18 10:10:29,659 INFO [RS:1;jenkins-hbase4:39709] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-18 10:10:29,659 INFO [RS:0;jenkins-hbase4:37417] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-18 10:10:29,659 INFO [RS:2;jenkins-hbase4:43301] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-18 10:10:29,659 DEBUG [RS:1;jenkins-hbase4:39709] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 10:10:29,659 DEBUG [RS:0;jenkins-hbase4:37417] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 10:10:29,660 DEBUG [RS:1;jenkins-hbase4:39709] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 10:10:29,660 DEBUG [RS:2;jenkins-hbase4:43301] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 10:10:29,660 DEBUG [RS:1;jenkins-hbase4:39709] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 10:10:29,660 DEBUG [RS:2;jenkins-hbase4:43301] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 10:10:29,660 DEBUG [RS:1;jenkins-hbase4:39709] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 10:10:29,660 DEBUG [RS:2;jenkins-hbase4:43301] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 10:10:29,660 DEBUG [RS:1;jenkins-hbase4:39709] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 10:10:29,660 DEBUG [RS:2;jenkins-hbase4:43301] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 10:10:29,661 DEBUG [RS:1;jenkins-hbase4:39709] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-18 10:10:29,661 DEBUG [RS:2;jenkins-hbase4:43301] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 10:10:29,661 DEBUG [RS:1;jenkins-hbase4:39709] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 10:10:29,661 DEBUG [RS:2;jenkins-hbase4:43301] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-18 10:10:29,661 DEBUG [RS:1;jenkins-hbase4:39709] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 10:10:29,661 DEBUG [RS:2;jenkins-hbase4:43301] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 10:10:29,661 DEBUG [RS:1;jenkins-hbase4:39709] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 10:10:29,661 DEBUG [RS:2;jenkins-hbase4:43301] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 10:10:29,661 DEBUG [RS:1;jenkins-hbase4:39709] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 10:10:29,660 DEBUG [RS:0;jenkins-hbase4:37417] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 10:10:29,661 DEBUG [RS:2;jenkins-hbase4:43301] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 10:10:29,661 DEBUG [RS:0;jenkins-hbase4:37417] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 10:10:29,662 DEBUG [RS:2;jenkins-hbase4:43301] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 10:10:29,662 DEBUG [RS:0;jenkins-hbase4:37417] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 10:10:29,662 DEBUG [RS:0;jenkins-hbase4:37417] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 10:10:29,662 DEBUG [RS:0;jenkins-hbase4:37417] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-18 10:10:29,662 DEBUG [RS:0;jenkins-hbase4:37417] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 10:10:29,662 DEBUG [RS:0;jenkins-hbase4:37417] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 10:10:29,662 DEBUG [RS:0;jenkins-hbase4:37417] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 10:10:29,662 DEBUG [RS:0;jenkins-hbase4:37417] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 10:10:29,668 INFO [RS:1;jenkins-hbase4:39709] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-18 10:10:29,668 INFO [RS:1;jenkins-hbase4:39709] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-18 10:10:29,668 INFO [RS:1;jenkins-hbase4:39709] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-18 10:10:29,671 INFO [RS:0;jenkins-hbase4:37417] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-18 10:10:29,672 INFO [RS:0;jenkins-hbase4:37417] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-18 10:10:29,672 INFO [RS:0;jenkins-hbase4:37417] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-18 10:10:29,683 INFO [RS:2;jenkins-hbase4:43301] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-18 10:10:29,684 INFO [RS:2;jenkins-hbase4:43301] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-18 10:10:29,684 INFO [RS:2;jenkins-hbase4:43301] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-18 10:10:29,689 INFO [RS:1;jenkins-hbase4:39709] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-18 10:10:29,694 INFO [RS:1;jenkins-hbase4:39709] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39709,1689675027617-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-18 10:10:29,691 INFO [RS:0;jenkins-hbase4:37417] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-18 10:10:29,697 INFO [RS:0;jenkins-hbase4:37417] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37417,1689675027545-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-18 10:10:29,701 INFO [RS:2;jenkins-hbase4:43301] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-18 10:10:29,701 INFO [RS:2;jenkins-hbase4:43301] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43301,1689675027670-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-18 10:10:29,740 INFO [RS:1;jenkins-hbase4:39709] regionserver.Replication(203): jenkins-hbase4.apache.org,39709,1689675027617 started 2023-07-18 10:10:29,740 INFO [RS:1;jenkins-hbase4:39709] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,39709,1689675027617, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:39709, sessionid=0x10177e94dd40002 2023-07-18 10:10:29,740 DEBUG [RS:1;jenkins-hbase4:39709] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-18 10:10:29,740 DEBUG [RS:1;jenkins-hbase4:39709] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:10:29,741 DEBUG [RS:1;jenkins-hbase4:39709] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39709,1689675027617' 2023-07-18 10:10:29,741 DEBUG [RS:1;jenkins-hbase4:39709] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-18 10:10:29,744 DEBUG [RS:1;jenkins-hbase4:39709] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-18 10:10:29,745 INFO [RS:2;jenkins-hbase4:43301] regionserver.Replication(203): jenkins-hbase4.apache.org,43301,1689675027670 started 2023-07-18 10:10:29,745 INFO [RS:2;jenkins-hbase4:43301] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,43301,1689675027670, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:43301, sessionid=0x10177e94dd40003 2023-07-18 10:10:29,745 DEBUG [RS:2;jenkins-hbase4:43301] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-18 10:10:29,745 DEBUG [RS:2;jenkins-hbase4:43301] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:29,751 DEBUG [RS:2;jenkins-hbase4:43301] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43301,1689675027670' 2023-07-18 10:10:29,752 DEBUG [RS:2;jenkins-hbase4:43301] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-18 10:10:29,753 DEBUG [RS:2;jenkins-hbase4:43301] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-18 10:10:29,754 INFO [RS:0;jenkins-hbase4:37417] regionserver.Replication(203): jenkins-hbase4.apache.org,37417,1689675027545 started 2023-07-18 10:10:29,755 INFO [RS:0;jenkins-hbase4:37417] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,37417,1689675027545, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:37417, sessionid=0x10177e94dd40001 2023-07-18 10:10:29,756 DEBUG [RS:0;jenkins-hbase4:37417] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-18 10:10:29,756 DEBUG [RS:0;jenkins-hbase4:37417] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:10:29,756 DEBUG [RS:0;jenkins-hbase4:37417] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37417,1689675027545' 2023-07-18 10:10:29,756 DEBUG [RS:0;jenkins-hbase4:37417] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-18 10:10:29,756 DEBUG [RS:1;jenkins-hbase4:39709] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-18 10:10:29,756 DEBUG [RS:1;jenkins-hbase4:39709] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-18 10:10:29,756 DEBUG [RS:1;jenkins-hbase4:39709] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:10:29,756 DEBUG [RS:1;jenkins-hbase4:39709] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39709,1689675027617' 2023-07-18 10:10:29,756 DEBUG [RS:1;jenkins-hbase4:39709] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:10:29,757 DEBUG [RS:2;jenkins-hbase4:43301] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-18 10:10:29,757 DEBUG [RS:2;jenkins-hbase4:43301] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-18 10:10:29,758 DEBUG [RS:1;jenkins-hbase4:39709] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:10:29,757 DEBUG [RS:0;jenkins-hbase4:37417] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-18 10:10:29,759 DEBUG [jenkins-hbase4:38235] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-18 10:10:29,758 DEBUG [RS:2;jenkins-hbase4:43301] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:29,759 DEBUG [RS:2;jenkins-hbase4:43301] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43301,1689675027670' 2023-07-18 10:10:29,760 DEBUG [RS:2;jenkins-hbase4:43301] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:10:29,760 DEBUG [RS:1;jenkins-hbase4:39709] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-18 10:10:29,760 INFO [RS:1;jenkins-hbase4:39709] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-18 10:10:29,760 INFO [RS:1;jenkins-hbase4:39709] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-18 10:10:29,760 DEBUG [RS:2;jenkins-hbase4:43301] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:10:29,761 DEBUG [RS:2;jenkins-hbase4:43301] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-18 10:10:29,761 INFO [RS:2;jenkins-hbase4:43301] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-18 10:10:29,762 INFO [RS:2;jenkins-hbase4:43301] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-18 10:10:29,764 DEBUG [RS:0;jenkins-hbase4:37417] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-18 10:10:29,764 DEBUG [RS:0;jenkins-hbase4:37417] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-18 10:10:29,765 DEBUG [RS:0;jenkins-hbase4:37417] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:10:29,765 DEBUG [RS:0;jenkins-hbase4:37417] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37417,1689675027545' 2023-07-18 10:10:29,765 DEBUG [RS:0;jenkins-hbase4:37417] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:10:29,765 DEBUG [RS:0;jenkins-hbase4:37417] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:10:29,766 DEBUG [RS:0;jenkins-hbase4:37417] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-18 10:10:29,766 INFO [RS:0;jenkins-hbase4:37417] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-18 10:10:29,766 INFO [RS:0;jenkins-hbase4:37417] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-18 10:10:29,769 DEBUG [jenkins-hbase4:38235] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 10:10:29,781 DEBUG [jenkins-hbase4:38235] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 10:10:29,781 DEBUG [jenkins-hbase4:38235] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 10:10:29,781 DEBUG [jenkins-hbase4:38235] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-18 10:10:29,782 DEBUG [jenkins-hbase4:38235] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 10:10:29,785 INFO [PEWorker-2] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,39709,1689675027617, state=OPENING 2023-07-18 10:10:29,794 DEBUG [PEWorker-2] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-18 10:10:29,796 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 10:10:29,796 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-18 10:10:29,806 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,39709,1689675027617}] 2023-07-18 10:10:29,875 INFO [RS:1;jenkins-hbase4:39709] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39709%2C1689675027617, suffix=, logDir=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/WALs/jenkins-hbase4.apache.org,39709,1689675027617, archiveDir=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/oldWALs, maxLogs=32 2023-07-18 10:10:29,885 INFO [RS:0;jenkins-hbase4:37417] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37417%2C1689675027545, suffix=, logDir=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/WALs/jenkins-hbase4.apache.org,37417,1689675027545, archiveDir=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/oldWALs, maxLogs=32 2023-07-18 10:10:29,884 INFO [RS:2;jenkins-hbase4:43301] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43301%2C1689675027670, suffix=, logDir=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/WALs/jenkins-hbase4.apache.org,43301,1689675027670, archiveDir=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/oldWALs, maxLogs=32 2023-07-18 10:10:29,924 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38469,DS-d5ea5d57-261e-42e7-8930-9b2f278e5fbb,DISK] 2023-07-18 10:10:29,924 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39715,DS-7ddfeaca-9266-438b-8921-55c4dc71227d,DISK] 2023-07-18 10:10:29,925 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36009,DS-5ec3be7b-5664-4467-9753-5eb2ed3326e5,DISK] 2023-07-18 10:10:29,969 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38469,DS-d5ea5d57-261e-42e7-8930-9b2f278e5fbb,DISK] 2023-07-18 10:10:29,969 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36009,DS-5ec3be7b-5664-4467-9753-5eb2ed3326e5,DISK] 2023-07-18 10:10:29,970 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39715,DS-7ddfeaca-9266-438b-8921-55c4dc71227d,DISK] 2023-07-18 10:10:29,980 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38469,DS-d5ea5d57-261e-42e7-8930-9b2f278e5fbb,DISK] 2023-07-18 10:10:29,980 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36009,DS-5ec3be7b-5664-4467-9753-5eb2ed3326e5,DISK] 2023-07-18 10:10:29,980 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39715,DS-7ddfeaca-9266-438b-8921-55c4dc71227d,DISK] 2023-07-18 10:10:29,982 INFO [RS:1;jenkins-hbase4:39709] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/WALs/jenkins-hbase4.apache.org,39709,1689675027617/jenkins-hbase4.apache.org%2C39709%2C1689675027617.1689675029879 2023-07-18 10:10:29,994 DEBUG [RS:1;jenkins-hbase4:39709] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38469,DS-d5ea5d57-261e-42e7-8930-9b2f278e5fbb,DISK], DatanodeInfoWithStorage[127.0.0.1:39715,DS-7ddfeaca-9266-438b-8921-55c4dc71227d,DISK], DatanodeInfoWithStorage[127.0.0.1:36009,DS-5ec3be7b-5664-4467-9753-5eb2ed3326e5,DISK]] 2023-07-18 10:10:30,000 INFO [RS:2;jenkins-hbase4:43301] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/WALs/jenkins-hbase4.apache.org,43301,1689675027670/jenkins-hbase4.apache.org%2C43301%2C1689675027670.1689675029895 2023-07-18 10:10:30,009 DEBUG [RS:2;jenkins-hbase4:43301] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36009,DS-5ec3be7b-5664-4467-9753-5eb2ed3326e5,DISK], DatanodeInfoWithStorage[127.0.0.1:38469,DS-d5ea5d57-261e-42e7-8930-9b2f278e5fbb,DISK], DatanodeInfoWithStorage[127.0.0.1:39715,DS-7ddfeaca-9266-438b-8921-55c4dc71227d,DISK]] 2023-07-18 10:10:30,013 INFO [RS:0;jenkins-hbase4:37417] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/WALs/jenkins-hbase4.apache.org,37417,1689675027545/jenkins-hbase4.apache.org%2C37417%2C1689675027545.1689675029887 2023-07-18 10:10:30,023 DEBUG [RS:0;jenkins-hbase4:37417] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39715,DS-7ddfeaca-9266-438b-8921-55c4dc71227d,DISK], DatanodeInfoWithStorage[127.0.0.1:36009,DS-5ec3be7b-5664-4467-9753-5eb2ed3326e5,DISK], DatanodeInfoWithStorage[127.0.0.1:38469,DS-d5ea5d57-261e-42e7-8930-9b2f278e5fbb,DISK]] 2023-07-18 10:10:30,028 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:10:30,034 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-18 10:10:30,040 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42472, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-18 10:10:30,055 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-18 10:10:30,056 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-18 10:10:30,062 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39709%2C1689675027617.meta, suffix=.meta, logDir=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/WALs/jenkins-hbase4.apache.org,39709,1689675027617, archiveDir=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/oldWALs, maxLogs=32 2023-07-18 10:10:30,084 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39715,DS-7ddfeaca-9266-438b-8921-55c4dc71227d,DISK] 2023-07-18 10:10:30,096 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36009,DS-5ec3be7b-5664-4467-9753-5eb2ed3326e5,DISK] 2023-07-18 10:10:30,098 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38469,DS-d5ea5d57-261e-42e7-8930-9b2f278e5fbb,DISK] 2023-07-18 10:10:30,118 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/WALs/jenkins-hbase4.apache.org,39709,1689675027617/jenkins-hbase4.apache.org%2C39709%2C1689675027617.meta.1689675030063.meta 2023-07-18 10:10:30,118 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39715,DS-7ddfeaca-9266-438b-8921-55c4dc71227d,DISK], DatanodeInfoWithStorage[127.0.0.1:36009,DS-5ec3be7b-5664-4467-9753-5eb2ed3326e5,DISK], DatanodeInfoWithStorage[127.0.0.1:38469,DS-d5ea5d57-261e-42e7-8930-9b2f278e5fbb,DISK]] 2023-07-18 10:10:30,119 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-18 10:10:30,120 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-18 10:10:30,121 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 10:10:30,122 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-18 10:10:30,125 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-18 10:10:30,126 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-18 10:10:30,146 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-18 10:10:30,146 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 10:10:30,146 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-18 10:10:30,146 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-18 10:10:30,150 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-18 10:10:30,152 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/hbase/meta/1588230740/info 2023-07-18 10:10:30,153 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/hbase/meta/1588230740/info 2023-07-18 10:10:30,153 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-18 10:10:30,154 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 10:10:30,154 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-18 10:10:30,156 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/hbase/meta/1588230740/rep_barrier 2023-07-18 10:10:30,156 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/hbase/meta/1588230740/rep_barrier 2023-07-18 10:10:30,157 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-18 10:10:30,158 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 10:10:30,158 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-18 10:10:30,160 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/hbase/meta/1588230740/table 2023-07-18 10:10:30,160 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/hbase/meta/1588230740/table 2023-07-18 10:10:30,161 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-18 10:10:30,161 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 10:10:30,164 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/hbase/meta/1588230740 2023-07-18 10:10:30,167 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/hbase/meta/1588230740 2023-07-18 10:10:30,171 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-18 10:10:30,179 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-18 10:10:30,181 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73038569, jitterRate=0.08835949003696442}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-18 10:10:30,184 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-18 10:10:30,200 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689675030017 2023-07-18 10:10:30,229 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,39709,1689675027617, state=OPEN 2023-07-18 10:10:30,234 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-18 10:10:30,234 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-18 10:10:30,235 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-18 10:10:30,237 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-18 10:10:30,240 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-18 10:10:30,240 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,39709,1689675027617 in 428 msec 2023-07-18 10:10:30,250 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-18 10:10:30,250 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 666 msec 2023-07-18 10:10:30,257 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.1010 sec 2023-07-18 10:10:30,258 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689675030257, completionTime=-1 2023-07-18 10:10:30,258 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-18 10:10:30,258 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-18 10:10:30,335 DEBUG [hconnection-0x36ae74de-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 10:10:30,338 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56080, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 10:10:30,370 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-18 10:10:30,370 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689675090370 2023-07-18 10:10:30,370 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689675150370 2023-07-18 10:10:30,371 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 112 msec 2023-07-18 10:10:30,397 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38235,1689675026088-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-18 10:10:30,398 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38235,1689675026088-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-18 10:10:30,398 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38235,1689675026088-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-18 10:10:30,401 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:38235, period=300000, unit=MILLISECONDS is enabled. 2023-07-18 10:10:30,401 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-18 10:10:30,409 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-18 10:10:30,419 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-18 10:10:30,421 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-18 10:10:30,433 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-18 10:10:30,436 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-18 10:10:30,440 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-18 10:10:30,469 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/hbase/namespace/0e5e0781d45bc8cd4efbc8924275e1db 2023-07-18 10:10:30,473 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/hbase/namespace/0e5e0781d45bc8cd4efbc8924275e1db empty. 2023-07-18 10:10:30,474 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/hbase/namespace/0e5e0781d45bc8cd4efbc8924275e1db 2023-07-18 10:10:30,474 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-18 10:10:30,566 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-18 10:10:30,571 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 0e5e0781d45bc8cd4efbc8924275e1db, NAME => 'hbase:namespace,,1689675030420.0e5e0781d45bc8cd4efbc8924275e1db.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp 2023-07-18 10:10:30,594 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689675030420.0e5e0781d45bc8cd4efbc8924275e1db.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 10:10:30,594 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 0e5e0781d45bc8cd4efbc8924275e1db, disabling compactions & flushes 2023-07-18 10:10:30,594 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689675030420.0e5e0781d45bc8cd4efbc8924275e1db. 2023-07-18 10:10:30,594 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689675030420.0e5e0781d45bc8cd4efbc8924275e1db. 2023-07-18 10:10:30,594 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689675030420.0e5e0781d45bc8cd4efbc8924275e1db. after waiting 0 ms 2023-07-18 10:10:30,594 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689675030420.0e5e0781d45bc8cd4efbc8924275e1db. 2023-07-18 10:10:30,594 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689675030420.0e5e0781d45bc8cd4efbc8924275e1db. 2023-07-18 10:10:30,594 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 0e5e0781d45bc8cd4efbc8924275e1db: 2023-07-18 10:10:30,600 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-18 10:10:30,616 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689675030420.0e5e0781d45bc8cd4efbc8924275e1db.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689675030603"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689675030603"}]},"ts":"1689675030603"} 2023-07-18 10:10:30,646 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-18 10:10:30,649 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-18 10:10:30,654 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689675030649"}]},"ts":"1689675030649"} 2023-07-18 10:10:30,661 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-18 10:10:30,669 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 10:10:30,670 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 10:10:30,671 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 10:10:30,671 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-18 10:10:30,671 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 10:10:30,674 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=0e5e0781d45bc8cd4efbc8924275e1db, ASSIGN}] 2023-07-18 10:10:30,679 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=0e5e0781d45bc8cd4efbc8924275e1db, ASSIGN 2023-07-18 10:10:30,684 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=0e5e0781d45bc8cd4efbc8924275e1db, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43301,1689675027670; forceNewPlan=false, retain=false 2023-07-18 10:10:30,836 INFO [jenkins-hbase4:38235] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-18 10:10:30,837 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=0e5e0781d45bc8cd4efbc8924275e1db, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:30,837 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689675030420.0e5e0781d45bc8cd4efbc8924275e1db.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689675030836"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689675030836"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689675030836"}]},"ts":"1689675030836"} 2023-07-18 10:10:30,841 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 0e5e0781d45bc8cd4efbc8924275e1db, server=jenkins-hbase4.apache.org,43301,1689675027670}] 2023-07-18 10:10:30,997 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:30,997 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-18 10:10:31,001 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37796, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-18 10:10:31,009 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689675030420.0e5e0781d45bc8cd4efbc8924275e1db. 2023-07-18 10:10:31,010 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0e5e0781d45bc8cd4efbc8924275e1db, NAME => 'hbase:namespace,,1689675030420.0e5e0781d45bc8cd4efbc8924275e1db.', STARTKEY => '', ENDKEY => ''} 2023-07-18 10:10:31,010 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689675030420.0e5e0781d45bc8cd4efbc8924275e1db. service=AccessControlService 2023-07-18 10:10:31,011 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 10:10:31,012 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 0e5e0781d45bc8cd4efbc8924275e1db 2023-07-18 10:10:31,012 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689675030420.0e5e0781d45bc8cd4efbc8924275e1db.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 10:10:31,012 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0e5e0781d45bc8cd4efbc8924275e1db 2023-07-18 10:10:31,012 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0e5e0781d45bc8cd4efbc8924275e1db 2023-07-18 10:10:31,014 INFO [StoreOpener-0e5e0781d45bc8cd4efbc8924275e1db-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 0e5e0781d45bc8cd4efbc8924275e1db 2023-07-18 10:10:31,017 DEBUG [StoreOpener-0e5e0781d45bc8cd4efbc8924275e1db-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/hbase/namespace/0e5e0781d45bc8cd4efbc8924275e1db/info 2023-07-18 10:10:31,017 DEBUG [StoreOpener-0e5e0781d45bc8cd4efbc8924275e1db-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/hbase/namespace/0e5e0781d45bc8cd4efbc8924275e1db/info 2023-07-18 10:10:31,017 INFO [StoreOpener-0e5e0781d45bc8cd4efbc8924275e1db-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0e5e0781d45bc8cd4efbc8924275e1db columnFamilyName info 2023-07-18 10:10:31,018 INFO [StoreOpener-0e5e0781d45bc8cd4efbc8924275e1db-1] regionserver.HStore(310): Store=0e5e0781d45bc8cd4efbc8924275e1db/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 10:10:31,021 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/hbase/namespace/0e5e0781d45bc8cd4efbc8924275e1db 2023-07-18 10:10:31,022 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/hbase/namespace/0e5e0781d45bc8cd4efbc8924275e1db 2023-07-18 10:10:31,027 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0e5e0781d45bc8cd4efbc8924275e1db 2023-07-18 10:10:31,032 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/hbase/namespace/0e5e0781d45bc8cd4efbc8924275e1db/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 10:10:31,032 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0e5e0781d45bc8cd4efbc8924275e1db; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72939704, jitterRate=0.08688628673553467}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 10:10:31,033 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0e5e0781d45bc8cd4efbc8924275e1db: 2023-07-18 10:10:31,036 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689675030420.0e5e0781d45bc8cd4efbc8924275e1db., pid=6, masterSystemTime=1689675030997 2023-07-18 10:10:31,043 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689675030420.0e5e0781d45bc8cd4efbc8924275e1db. 2023-07-18 10:10:31,045 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689675030420.0e5e0781d45bc8cd4efbc8924275e1db. 2023-07-18 10:10:31,052 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=0e5e0781d45bc8cd4efbc8924275e1db, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:31,052 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689675030420.0e5e0781d45bc8cd4efbc8924275e1db.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689675031051"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689675031051"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689675031051"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689675031051"}]},"ts":"1689675031051"} 2023-07-18 10:10:31,060 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-18 10:10:31,060 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 0e5e0781d45bc8cd4efbc8924275e1db, server=jenkins-hbase4.apache.org,43301,1689675027670 in 215 msec 2023-07-18 10:10:31,065 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-18 10:10:31,066 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=0e5e0781d45bc8cd4efbc8924275e1db, ASSIGN in 386 msec 2023-07-18 10:10:31,067 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-18 10:10:31,068 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689675031068"}]},"ts":"1689675031068"} 2023-07-18 10:10:31,071 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-18 10:10:31,077 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-18 10:10:31,081 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 656 msec 2023-07-18 10:10:31,144 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-18 10:10:31,146 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-18 10:10:31,146 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 10:10:31,175 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 10:10:31,177 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37804, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 10:10:31,194 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-18 10:10:31,217 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-18 10:10:31,226 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 42 msec 2023-07-18 10:10:31,239 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-18 10:10:31,261 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-18 10:10:31,271 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 27 msec 2023-07-18 10:10:31,295 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-18 10:10:31,298 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-18 10:10:31,301 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.546sec 2023-07-18 10:10:31,305 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-18 10:10:31,307 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-18 10:10:31,307 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-18 10:10:31,308 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38235,1689675026088-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-18 10:10:31,309 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38235,1689675026088-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-18 10:10:31,327 DEBUG [Listener at localhost/33477] zookeeper.ReadOnlyZKClient(139): Connect 0x0789e732 to 127.0.0.1:60990 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 10:10:31,336 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-18 10:10:31,338 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-18 10:10:31,349 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-18 10:10:31,351 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-18 10:10:31,359 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-18 10:10:31,359 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/hbase/acl/7121957271154b496922f73cd6af8f4b 2023-07-18 10:10:31,361 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/hbase/acl/7121957271154b496922f73cd6af8f4b empty. 2023-07-18 10:10:31,364 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/hbase/acl/7121957271154b496922f73cd6af8f4b 2023-07-18 10:10:31,364 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-18 10:10:31,368 DEBUG [Listener at localhost/33477] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4cd4fb6c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 10:10:31,370 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-18 10:10:31,399 DEBUG [hconnection-0x422c7ffb-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 10:10:31,432 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-18 10:10:31,435 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 7121957271154b496922f73cd6af8f4b, NAME => 'hbase:acl,,1689675031330.7121957271154b496922f73cd6af8f4b.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp 2023-07-18 10:10:31,435 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56086, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 10:10:31,439 INFO [Listener at localhost/33477] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,38235,1689675026088 2023-07-18 10:10:31,439 INFO [Listener at localhost/33477] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-18 10:10:31,439 INFO [Listener at localhost/33477] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c329d283-1f43-4a99-3860-7ed90b9830ca/test.cache.data in system properties and HBase conf 2023-07-18 10:10:31,440 INFO [Listener at localhost/33477] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c329d283-1f43-4a99-3860-7ed90b9830ca/hadoop.tmp.dir in system properties and HBase conf 2023-07-18 10:10:31,440 INFO [Listener at localhost/33477] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c329d283-1f43-4a99-3860-7ed90b9830ca/hadoop.log.dir in system properties and HBase conf 2023-07-18 10:10:31,440 INFO [Listener at localhost/33477] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c329d283-1f43-4a99-3860-7ed90b9830ca/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-18 10:10:31,440 INFO [Listener at localhost/33477] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c329d283-1f43-4a99-3860-7ed90b9830ca/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-18 10:10:31,440 INFO [Listener at localhost/33477] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-18 10:10:31,440 INFO [Listener at localhost/33477] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c329d283-1f43-4a99-3860-7ed90b9830ca/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-18 10:10:31,440 INFO [Listener at localhost/33477] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c329d283-1f43-4a99-3860-7ed90b9830ca/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-18 10:10:31,441 INFO [Listener at localhost/33477] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c329d283-1f43-4a99-3860-7ed90b9830ca/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-18 10:10:31,441 INFO [Listener at localhost/33477] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c329d283-1f43-4a99-3860-7ed90b9830ca/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-18 10:10:31,441 INFO [Listener at localhost/33477] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c329d283-1f43-4a99-3860-7ed90b9830ca/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-18 10:10:31,441 INFO [Listener at localhost/33477] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c329d283-1f43-4a99-3860-7ed90b9830ca/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-18 10:10:31,441 INFO [Listener at localhost/33477] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c329d283-1f43-4a99-3860-7ed90b9830ca/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-18 10:10:31,441 INFO [Listener at localhost/33477] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c329d283-1f43-4a99-3860-7ed90b9830ca/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-18 10:10:31,441 INFO [Listener at localhost/33477] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c329d283-1f43-4a99-3860-7ed90b9830ca/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-18 10:10:31,441 INFO [Listener at localhost/33477] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c329d283-1f43-4a99-3860-7ed90b9830ca/nfs.dump.dir in system properties and HBase conf 2023-07-18 10:10:31,442 INFO [Listener at localhost/33477] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c329d283-1f43-4a99-3860-7ed90b9830ca/java.io.tmpdir in system properties and HBase conf 2023-07-18 10:10:31,442 INFO [Listener at localhost/33477] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c329d283-1f43-4a99-3860-7ed90b9830ca/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-18 10:10:31,442 INFO [Listener at localhost/33477] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c329d283-1f43-4a99-3860-7ed90b9830ca/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-18 10:10:31,442 INFO [Listener at localhost/33477] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c329d283-1f43-4a99-3860-7ed90b9830ca/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-18 10:10:31,485 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-18 10:10:31,488 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689675031330.7121957271154b496922f73cd6af8f4b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 10:10:31,488 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 7121957271154b496922f73cd6af8f4b, disabling compactions & flushes 2023-07-18 10:10:31,488 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689675031330.7121957271154b496922f73cd6af8f4b. 2023-07-18 10:10:31,488 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689675031330.7121957271154b496922f73cd6af8f4b. 2023-07-18 10:10:31,488 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689675031330.7121957271154b496922f73cd6af8f4b. after waiting 0 ms 2023-07-18 10:10:31,488 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689675031330.7121957271154b496922f73cd6af8f4b. 2023-07-18 10:10:31,489 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1689675031330.7121957271154b496922f73cd6af8f4b. 2023-07-18 10:10:31,489 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 7121957271154b496922f73cd6af8f4b: 2023-07-18 10:10:31,496 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-18 10:10:31,497 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1689675031330.7121957271154b496922f73cd6af8f4b.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689675031497"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689675031497"}]},"ts":"1689675031497"} 2023-07-18 10:10:31,502 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-18 10:10:31,504 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-18 10:10:31,505 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689675031504"}]},"ts":"1689675031504"} 2023-07-18 10:10:31,508 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-18 10:10:31,520 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 10:10:31,521 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 10:10:31,521 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 10:10:31,521 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-18 10:10:31,522 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 10:10:31,522 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=7121957271154b496922f73cd6af8f4b, ASSIGN}] 2023-07-18 10:10:31,532 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=7121957271154b496922f73cd6af8f4b, ASSIGN 2023-07-18 10:10:31,551 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=7121957271154b496922f73cd6af8f4b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43301,1689675027670; forceNewPlan=false, retain=false 2023-07-18 10:10:31,688 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-18 10:10:31,701 INFO [jenkins-hbase4:38235] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-18 10:10:31,702 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=7121957271154b496922f73cd6af8f4b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:31,703 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1689675031330.7121957271154b496922f73cd6af8f4b.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689675031702"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689675031702"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689675031702"}]},"ts":"1689675031702"} 2023-07-18 10:10:31,706 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 7121957271154b496922f73cd6af8f4b, server=jenkins-hbase4.apache.org,43301,1689675027670}] 2023-07-18 10:10:31,868 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1689675031330.7121957271154b496922f73cd6af8f4b. 2023-07-18 10:10:31,869 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7121957271154b496922f73cd6af8f4b, NAME => 'hbase:acl,,1689675031330.7121957271154b496922f73cd6af8f4b.', STARTKEY => '', ENDKEY => ''} 2023-07-18 10:10:31,869 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689675031330.7121957271154b496922f73cd6af8f4b. service=AccessControlService 2023-07-18 10:10:31,869 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 10:10:31,869 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 7121957271154b496922f73cd6af8f4b 2023-07-18 10:10:31,870 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689675031330.7121957271154b496922f73cd6af8f4b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 10:10:31,870 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7121957271154b496922f73cd6af8f4b 2023-07-18 10:10:31,870 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7121957271154b496922f73cd6af8f4b 2023-07-18 10:10:31,872 INFO [StoreOpener-7121957271154b496922f73cd6af8f4b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 7121957271154b496922f73cd6af8f4b 2023-07-18 10:10:31,875 DEBUG [StoreOpener-7121957271154b496922f73cd6af8f4b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/hbase/acl/7121957271154b496922f73cd6af8f4b/l 2023-07-18 10:10:31,875 DEBUG [StoreOpener-7121957271154b496922f73cd6af8f4b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/hbase/acl/7121957271154b496922f73cd6af8f4b/l 2023-07-18 10:10:31,876 INFO [StoreOpener-7121957271154b496922f73cd6af8f4b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7121957271154b496922f73cd6af8f4b columnFamilyName l 2023-07-18 10:10:31,877 INFO [StoreOpener-7121957271154b496922f73cd6af8f4b-1] regionserver.HStore(310): Store=7121957271154b496922f73cd6af8f4b/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 10:10:31,879 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/hbase/acl/7121957271154b496922f73cd6af8f4b 2023-07-18 10:10:31,881 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/hbase/acl/7121957271154b496922f73cd6af8f4b 2023-07-18 10:10:31,887 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7121957271154b496922f73cd6af8f4b 2023-07-18 10:10:31,893 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/hbase/acl/7121957271154b496922f73cd6af8f4b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 10:10:31,894 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7121957271154b496922f73cd6af8f4b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63919845, jitterRate=-0.04752008616924286}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 10:10:31,894 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7121957271154b496922f73cd6af8f4b: 2023-07-18 10:10:31,897 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1689675031330.7121957271154b496922f73cd6af8f4b., pid=11, masterSystemTime=1689675031860 2023-07-18 10:10:31,905 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1689675031330.7121957271154b496922f73cd6af8f4b. 2023-07-18 10:10:31,905 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1689675031330.7121957271154b496922f73cd6af8f4b. 2023-07-18 10:10:31,906 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=7121957271154b496922f73cd6af8f4b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:31,906 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1689675031330.7121957271154b496922f73cd6af8f4b.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689675031905"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689675031905"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689675031905"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689675031905"}]},"ts":"1689675031905"} 2023-07-18 10:10:31,915 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-18 10:10:31,915 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 7121957271154b496922f73cd6af8f4b, server=jenkins-hbase4.apache.org,43301,1689675027670 in 204 msec 2023-07-18 10:10:31,920 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-18 10:10:31,920 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=7121957271154b496922f73cd6af8f4b, ASSIGN in 393 msec 2023-07-18 10:10:31,922 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-18 10:10:31,922 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689675031922"}]},"ts":"1689675031922"} 2023-07-18 10:10:31,925 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-18 10:10:31,930 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-18 10:10:31,935 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 595 msec 2023-07-18 10:10:31,988 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-18 10:10:31,988 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-18 10:10:32,005 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-18 10:10:32,881 WARN [Thread-384] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-18 10:10:33,198 INFO [Thread-384] log.Slf4jLog(67): jetty-6.1.26 2023-07-18 10:10:33,205 INFO [Thread-384] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c329d283-1f43-4a99-3860-7ed90b9830ca/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_46085_jobhistory____bl2u6s/webapp 2023-07-18 10:10:33,371 INFO [Thread-384] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-18 10:10:33,371 INFO [Thread-384] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-18 10:10:33,371 INFO [Thread-384] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-18 10:10:33,373 INFO [Thread-384] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-18 10:10:33,442 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-18 10:10:33,731 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-18 10:10:34,121 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-18 10:10:34,202 INFO [Thread-384] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:46085 2023-07-18 10:10:34,387 WARN [Listener at jenkins-hbase4.apache.org/43977] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-18 10:10:34,842 WARN [Listener at jenkins-hbase4.apache.org/43977] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-18 10:10:34,843 INFO [Listener at jenkins-hbase4.apache.org/43977] log.Slf4jLog(67): jetty-6.1.26 2023-07-18 10:10:34,851 INFO [Listener at jenkins-hbase4.apache.org/43977] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c329d283-1f43-4a99-3860-7ed90b9830ca/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_38315_cluster____df59hu/webapp 2023-07-18 10:10:34,930 INFO [Listener at jenkins-hbase4.apache.org/43977] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-18 10:10:34,930 INFO [Listener at jenkins-hbase4.apache.org/43977] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-18 10:10:34,930 INFO [Listener at jenkins-hbase4.apache.org/43977] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-18 10:10:34,931 INFO [Listener at jenkins-hbase4.apache.org/43977] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-18 10:10:34,943 INFO [Listener at jenkins-hbase4.apache.org/43977] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-18 10:10:35,319 INFO [Listener at jenkins-hbase4.apache.org/43977] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-18 10:10:35,498 INFO [Listener at jenkins-hbase4.apache.org/43977] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-18 10:10:35,544 INFO [Listener at jenkins-hbase4.apache.org/43977] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:38315 2023-07-18 10:10:35,786 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-18 10:10:35,899 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-18 10:10:35,900 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-18 10:10:35,901 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-18 10:10:36,272 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 10:10:36,273 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-18 10:10:36,273 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 10:10:36,273 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-18 10:10:36,275 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-18 10:10:36,275 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-18 10:10:36,275 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 10:10:36,276 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-18 10:10:36,276 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-18 10:10:36,276 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-18 10:10:36,280 WARN [Listener at jenkins-hbase4.apache.org/37531] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-18 10:10:36,307 WARN [Listener at jenkins-hbase4.apache.org/37531] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-18 10:10:36,308 INFO [Listener at jenkins-hbase4.apache.org/37531] log.Slf4jLog(67): jetty-6.1.26 2023-07-18 10:10:36,319 INFO [Listener at jenkins-hbase4.apache.org/37531] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c329d283-1f43-4a99-3860-7ed90b9830ca/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_34027_node____.dfzj2m/webapp 2023-07-18 10:10:36,380 INFO [Listener at jenkins-hbase4.apache.org/37531] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-18 10:10:36,381 INFO [Listener at jenkins-hbase4.apache.org/37531] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-18 10:10:36,381 INFO [Listener at jenkins-hbase4.apache.org/37531] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-18 10:10:36,381 INFO [Listener at jenkins-hbase4.apache.org/37531] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-18 10:10:36,389 INFO [Listener at jenkins-hbase4.apache.org/37531] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-18 10:10:36,411 INFO [Listener at jenkins-hbase4.apache.org/37531] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-18 10:10:36,509 INFO [Listener at jenkins-hbase4.apache.org/37531] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-18 10:10:36,551 INFO [Listener at jenkins-hbase4.apache.org/37531] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:34027 2023-07-18 10:10:36,845 WARN [Listener at jenkins-hbase4.apache.org/34477] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-18 10:10:36,853 WARN [Listener at jenkins-hbase4.apache.org/34477] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-18 10:10:36,854 INFO [Listener at jenkins-hbase4.apache.org/34477] log.Slf4jLog(67): jetty-6.1.26 2023-07-18 10:10:36,860 INFO [Listener at jenkins-hbase4.apache.org/34477] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c329d283-1f43-4a99-3860-7ed90b9830ca/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_45421_node____.qpp0ts/webapp 2023-07-18 10:10:36,946 INFO [Listener at jenkins-hbase4.apache.org/34477] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-18 10:10:36,946 INFO [Listener at jenkins-hbase4.apache.org/34477] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-18 10:10:36,946 INFO [Listener at jenkins-hbase4.apache.org/34477] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-18 10:10:36,946 INFO [Listener at jenkins-hbase4.apache.org/34477] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-18 10:10:36,956 INFO [Listener at jenkins-hbase4.apache.org/34477] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-18 10:10:36,976 INFO [Listener at jenkins-hbase4.apache.org/34477] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-18 10:10:37,079 INFO [Listener at jenkins-hbase4.apache.org/34477] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-18 10:10:37,091 INFO [Listener at jenkins-hbase4.apache.org/34477] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:45421 2023-07-18 10:10:37,114 INFO [Listener at jenkins-hbase4.apache.org/34477] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-18 10:10:37,115 INFO [Listener at jenkins-hbase4.apache.org/34477] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 10:10:37,187 INFO [Listener at jenkins-hbase4.apache.org/34477] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=705, OpenFileDescriptor=901, MaxFileDescriptor=60000, SystemLoadAverage=321, ProcessCount=178, AvailableMemoryMB=4831 2023-07-18 10:10:37,187 WARN [Listener at jenkins-hbase4.apache.org/34477] hbase.ResourceChecker(130): Thread=705 is superior to 500 2023-07-18 10:10:37,201 DEBUG [Listener at jenkins-hbase4.apache.org/34477] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-18 10:10:37,206 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48910, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-18 10:10:37,213 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-18 10:10:37,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-18 10:10:37,218 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-18 10:10:37,219 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-18 10:10:37,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-18 10:10:37,221 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-18 10:10:37,226 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportWithTargetName/5077a43ed1e6c9611287b336eee29ba4 2023-07-18 10:10:37,226 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportWithTargetName/0bfe26a983764d2364d352c3d6776ba9 2023-07-18 10:10:37,229 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportWithTargetName/5077a43ed1e6c9611287b336eee29ba4 empty. 2023-07-18 10:10:37,229 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportWithTargetName/0bfe26a983764d2364d352c3d6776ba9 empty. 2023-07-18 10:10:37,230 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportWithTargetName/5077a43ed1e6c9611287b336eee29ba4 2023-07-18 10:10:37,230 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportWithTargetName/0bfe26a983764d2364d352c3d6776ba9 2023-07-18 10:10:37,230 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-18 10:10:37,261 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-18 10:10:37,264 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 5077a43ed1e6c9611287b336eee29ba4, NAME => 'testtb-testExportWithTargetName,,1689675037213.5077a43ed1e6c9611287b336eee29ba4.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp 2023-07-18 10:10:37,264 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 0bfe26a983764d2364d352c3d6776ba9, NAME => 'testtb-testExportWithTargetName,1,1689675037213.0bfe26a983764d2364d352c3d6776ba9.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp 2023-07-18 10:10:37,311 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689675037213.0bfe26a983764d2364d352c3d6776ba9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 10:10:37,311 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 0bfe26a983764d2364d352c3d6776ba9, disabling compactions & flushes 2023-07-18 10:10:37,312 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689675037213.0bfe26a983764d2364d352c3d6776ba9. 2023-07-18 10:10:37,312 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689675037213.0bfe26a983764d2364d352c3d6776ba9. 2023-07-18 10:10:37,312 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689675037213.0bfe26a983764d2364d352c3d6776ba9. after waiting 0 ms 2023-07-18 10:10:37,312 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689675037213.0bfe26a983764d2364d352c3d6776ba9. 2023-07-18 10:10:37,312 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689675037213.0bfe26a983764d2364d352c3d6776ba9. 2023-07-18 10:10:37,312 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 0bfe26a983764d2364d352c3d6776ba9: 2023-07-18 10:10:37,315 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689675037213.5077a43ed1e6c9611287b336eee29ba4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 10:10:37,315 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 5077a43ed1e6c9611287b336eee29ba4, disabling compactions & flushes 2023-07-18 10:10:37,316 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689675037213.5077a43ed1e6c9611287b336eee29ba4. 2023-07-18 10:10:37,316 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689675037213.5077a43ed1e6c9611287b336eee29ba4. 2023-07-18 10:10:37,316 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689675037213.5077a43ed1e6c9611287b336eee29ba4. after waiting 0 ms 2023-07-18 10:10:37,316 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689675037213.5077a43ed1e6c9611287b336eee29ba4. 2023-07-18 10:10:37,316 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689675037213.5077a43ed1e6c9611287b336eee29ba4. 2023-07-18 10:10:37,316 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 5077a43ed1e6c9611287b336eee29ba4: 2023-07-18 10:10:37,320 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-18 10:10:37,322 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689675037213.0bfe26a983764d2364d352c3d6776ba9.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689675037321"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689675037321"}]},"ts":"1689675037321"} 2023-07-18 10:10:37,322 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689675037213.5077a43ed1e6c9611287b336eee29ba4.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689675037321"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689675037321"}]},"ts":"1689675037321"} 2023-07-18 10:10:37,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-18 10:10:37,377 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-18 10:10:37,379 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-18 10:10:37,379 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689675037379"}]},"ts":"1689675037379"} 2023-07-18 10:10:37,381 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-18 10:10:37,386 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 10:10:37,388 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 10:10:37,389 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 10:10:37,389 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-18 10:10:37,389 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 10:10:37,389 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5077a43ed1e6c9611287b336eee29ba4, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=0bfe26a983764d2364d352c3d6776ba9, ASSIGN}] 2023-07-18 10:10:37,392 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=0bfe26a983764d2364d352c3d6776ba9, ASSIGN 2023-07-18 10:10:37,392 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5077a43ed1e6c9611287b336eee29ba4, ASSIGN 2023-07-18 10:10:37,393 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=0bfe26a983764d2364d352c3d6776ba9, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39709,1689675027617; forceNewPlan=false, retain=false 2023-07-18 10:10:37,393 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5077a43ed1e6c9611287b336eee29ba4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43301,1689675027670; forceNewPlan=false, retain=false 2023-07-18 10:10:37,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-18 10:10:37,544 INFO [jenkins-hbase4:38235] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-18 10:10:37,546 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=5077a43ed1e6c9611287b336eee29ba4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:37,546 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=0bfe26a983764d2364d352c3d6776ba9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:10:37,547 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689675037213.5077a43ed1e6c9611287b336eee29ba4.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689675037546"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689675037546"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689675037546"}]},"ts":"1689675037546"} 2023-07-18 10:10:37,547 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689675037213.0bfe26a983764d2364d352c3d6776ba9.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689675037546"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689675037546"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689675037546"}]},"ts":"1689675037546"} 2023-07-18 10:10:37,550 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=13, state=RUNNABLE; OpenRegionProcedure 5077a43ed1e6c9611287b336eee29ba4, server=jenkins-hbase4.apache.org,43301,1689675027670}] 2023-07-18 10:10:37,552 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=14, state=RUNNABLE; OpenRegionProcedure 0bfe26a983764d2364d352c3d6776ba9, server=jenkins-hbase4.apache.org,39709,1689675027617}] 2023-07-18 10:10:37,709 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1689675037213.5077a43ed1e6c9611287b336eee29ba4. 2023-07-18 10:10:37,709 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5077a43ed1e6c9611287b336eee29ba4, NAME => 'testtb-testExportWithTargetName,,1689675037213.5077a43ed1e6c9611287b336eee29ba4.', STARTKEY => '', ENDKEY => '1'} 2023-07-18 10:10:37,710 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1689675037213.5077a43ed1e6c9611287b336eee29ba4. service=AccessControlService 2023-07-18 10:10:37,710 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 10:10:37,710 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 5077a43ed1e6c9611287b336eee29ba4 2023-07-18 10:10:37,710 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689675037213.5077a43ed1e6c9611287b336eee29ba4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 10:10:37,710 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5077a43ed1e6c9611287b336eee29ba4 2023-07-18 10:10:37,711 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5077a43ed1e6c9611287b336eee29ba4 2023-07-18 10:10:37,721 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1689675037213.0bfe26a983764d2364d352c3d6776ba9. 2023-07-18 10:10:37,722 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0bfe26a983764d2364d352c3d6776ba9, NAME => 'testtb-testExportWithTargetName,1,1689675037213.0bfe26a983764d2364d352c3d6776ba9.', STARTKEY => '1', ENDKEY => ''} 2023-07-18 10:10:37,722 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1689675037213.0bfe26a983764d2364d352c3d6776ba9. service=AccessControlService 2023-07-18 10:10:37,722 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 10:10:37,722 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 0bfe26a983764d2364d352c3d6776ba9 2023-07-18 10:10:37,723 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689675037213.0bfe26a983764d2364d352c3d6776ba9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 10:10:37,723 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0bfe26a983764d2364d352c3d6776ba9 2023-07-18 10:10:37,723 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0bfe26a983764d2364d352c3d6776ba9 2023-07-18 10:10:37,726 INFO [StoreOpener-0bfe26a983764d2364d352c3d6776ba9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0bfe26a983764d2364d352c3d6776ba9 2023-07-18 10:10:37,726 INFO [StoreOpener-5077a43ed1e6c9611287b336eee29ba4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 5077a43ed1e6c9611287b336eee29ba4 2023-07-18 10:10:37,729 DEBUG [StoreOpener-5077a43ed1e6c9611287b336eee29ba4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportWithTargetName/5077a43ed1e6c9611287b336eee29ba4/cf 2023-07-18 10:10:37,729 DEBUG [StoreOpener-0bfe26a983764d2364d352c3d6776ba9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportWithTargetName/0bfe26a983764d2364d352c3d6776ba9/cf 2023-07-18 10:10:37,729 DEBUG [StoreOpener-0bfe26a983764d2364d352c3d6776ba9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportWithTargetName/0bfe26a983764d2364d352c3d6776ba9/cf 2023-07-18 10:10:37,729 DEBUG [StoreOpener-5077a43ed1e6c9611287b336eee29ba4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportWithTargetName/5077a43ed1e6c9611287b336eee29ba4/cf 2023-07-18 10:10:37,734 INFO [StoreOpener-0bfe26a983764d2364d352c3d6776ba9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0bfe26a983764d2364d352c3d6776ba9 columnFamilyName cf 2023-07-18 10:10:37,734 INFO [StoreOpener-5077a43ed1e6c9611287b336eee29ba4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5077a43ed1e6c9611287b336eee29ba4 columnFamilyName cf 2023-07-18 10:10:37,741 INFO [StoreOpener-5077a43ed1e6c9611287b336eee29ba4-1] regionserver.HStore(310): Store=5077a43ed1e6c9611287b336eee29ba4/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 10:10:37,743 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportWithTargetName/5077a43ed1e6c9611287b336eee29ba4 2023-07-18 10:10:37,745 INFO [StoreOpener-0bfe26a983764d2364d352c3d6776ba9-1] regionserver.HStore(310): Store=0bfe26a983764d2364d352c3d6776ba9/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 10:10:37,746 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportWithTargetName/5077a43ed1e6c9611287b336eee29ba4 2023-07-18 10:10:37,746 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportWithTargetName/0bfe26a983764d2364d352c3d6776ba9 2023-07-18 10:10:37,747 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportWithTargetName/0bfe26a983764d2364d352c3d6776ba9 2023-07-18 10:10:37,763 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0bfe26a983764d2364d352c3d6776ba9 2023-07-18 10:10:37,763 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5077a43ed1e6c9611287b336eee29ba4 2023-07-18 10:10:37,767 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportWithTargetName/0bfe26a983764d2364d352c3d6776ba9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 10:10:37,767 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportWithTargetName/5077a43ed1e6c9611287b336eee29ba4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 10:10:37,768 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5077a43ed1e6c9611287b336eee29ba4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66043285, jitterRate=-0.01587836444377899}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 10:10:37,768 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0bfe26a983764d2364d352c3d6776ba9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67394130, jitterRate=0.0042507946491241455}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 10:10:37,768 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5077a43ed1e6c9611287b336eee29ba4: 2023-07-18 10:10:37,768 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0bfe26a983764d2364d352c3d6776ba9: 2023-07-18 10:10:37,770 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1689675037213.5077a43ed1e6c9611287b336eee29ba4., pid=15, masterSystemTime=1689675037703 2023-07-18 10:10:37,773 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1689675037213.5077a43ed1e6c9611287b336eee29ba4. 2023-07-18 10:10:37,773 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1689675037213.5077a43ed1e6c9611287b336eee29ba4. 2023-07-18 10:10:37,774 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=5077a43ed1e6c9611287b336eee29ba4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:37,775 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1689675037213.0bfe26a983764d2364d352c3d6776ba9., pid=16, masterSystemTime=1689675037706 2023-07-18 10:10:37,775 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1689675037213.5077a43ed1e6c9611287b336eee29ba4.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689675037774"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689675037774"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689675037774"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689675037774"}]},"ts":"1689675037774"} 2023-07-18 10:10:37,778 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1689675037213.0bfe26a983764d2364d352c3d6776ba9. 2023-07-18 10:10:37,778 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1689675037213.0bfe26a983764d2364d352c3d6776ba9. 2023-07-18 10:10:37,781 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=0bfe26a983764d2364d352c3d6776ba9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:10:37,782 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1689675037213.0bfe26a983764d2364d352c3d6776ba9.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689675037781"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689675037781"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689675037781"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689675037781"}]},"ts":"1689675037781"} 2023-07-18 10:10:37,786 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=13 2023-07-18 10:10:37,786 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=13, state=SUCCESS; OpenRegionProcedure 5077a43ed1e6c9611287b336eee29ba4, server=jenkins-hbase4.apache.org,43301,1689675027670 in 230 msec 2023-07-18 10:10:37,789 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5077a43ed1e6c9611287b336eee29ba4, ASSIGN in 397 msec 2023-07-18 10:10:37,795 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=14 2023-07-18 10:10:37,797 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=14, state=SUCCESS; OpenRegionProcedure 0bfe26a983764d2364d352c3d6776ba9, server=jenkins-hbase4.apache.org,39709,1689675027617 in 235 msec 2023-07-18 10:10:37,800 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=12 2023-07-18 10:10:37,800 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=0bfe26a983764d2364d352c3d6776ba9, ASSIGN in 407 msec 2023-07-18 10:10:37,802 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-18 10:10:37,802 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689675037802"}]},"ts":"1689675037802"} 2023-07-18 10:10:37,804 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-18 10:10:37,807 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-18 10:10:37,813 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-18 10:10:37,822 DEBUG [hconnection-0x3ab9cd2d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 10:10:37,825 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56098, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=ClientService 2023-07-18 10:10:37,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-18 10:10:37,834 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43301] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-18 10:10:37,874 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-18 10:10:37,874 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-18 10:10:37,874 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-18 10:10:37,874 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-18 10:10:37,874 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 10:10:37,881 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-18 10:10:37,881 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-18 10:10:37,881 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-18 10:10:37,881 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-18 10:10:37,885 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 669 msec 2023-07-18 10:10:38,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-18 10:10:38,328 INFO [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-18 10:10:38,332 DEBUG [Listener at jenkins-hbase4.apache.org/34477] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-18 10:10:38,333 DEBUG [Listener at jenkins-hbase4.apache.org/34477] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689675037213.5077a43ed1e6c9611287b336eee29ba4. 2023-07-18 10:10:38,336 INFO [Listener at jenkins-hbase4.apache.org/34477] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 10:10:38,362 DEBUG [hconnection-0x422c7ffb-shared-pool-4] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 10:10:38,368 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37814, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 10:10:38,390 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-18 10:10:38,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689675038390 (current time:1689675038390). 2023-07-18 10:10:38,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-18 10:10:38,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] zookeeper.ReadOnlyZKClient(139): Connect 0x20f43961 to 127.0.0.1:60990 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 10:10:38,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@31a2ce52, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 10:10:38,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 10:10:38,411 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56108, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 10:10:38,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x20f43961 to 127.0.0.1:60990 2023-07-18 10:10:38,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 10:10:38,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] zookeeper.ReadOnlyZKClient(139): Connect 0x1f349c2e to 127.0.0.1:60990 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 10:10:38,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@44629ef1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 10:10:38,443 DEBUG [hconnection-0x4b6cb58-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 10:10:38,445 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56116, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 10:10:38,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 10:10:38,452 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37816, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 10:10:38,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1f349c2e to 127.0.0.1:60990 2023-07-18 10:10:38,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 10:10:38,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-18 10:10:38,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-18 10:10:38,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-18 10:10:38,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-18 10:10:38,517 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-18 10:10:38,519 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689675638519 2023-07-18 10:10:38,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-18 10:10:38,519 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-18 10:10:38,522 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-18 10:10:38,528 DEBUG [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-18 10:10:38,528 DEBUG [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-18 10:10:38,530 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-18 10:10:38,532 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 18 msec 2023-07-18 10:10:38,533 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-18 10:10:38,534 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689675638534 2023-07-18 10:10:38,571 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,573 INFO [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-18 10:10:38,574 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:10:38,575 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-18 10:10:38,575 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-18 10:10:38,576 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,576 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,580 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:10:38,580 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:10:38,581 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:10:38,581 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:10:38,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:10:38,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:10:38,581 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:10:38,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:10:38,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:10:38,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,584 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,584 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-18 10:10:38,586 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-18 10:10:38,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-18 10:10:38,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,587 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-18 10:10:38,587 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-18 10:10:38,591 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-18 10:10:38,592 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:38,592 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:38,592 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:10:38,592 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,592 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,593 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,593 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:10:38,593 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-18 10:10:38,595 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-18 10:10:38,595 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:10:38,600 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-18 10:10:38,600 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-18 10:10:38,600 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-18 10:10:38,600 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:10:38,600 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-18 10:10:38,601 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:10:38,600 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39709,1689675027617' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-18 10:10:38,602 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-18 10:10:38,602 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-18 10:10:38,602 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43301,1689675027670' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-18 10:10:38,603 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-18 10:10:38,604 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-18 10:10:38,604 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37417,1689675027545' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-18 10:10:38,607 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,607 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,607 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 10:10:38,609 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:10:38,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:10:38,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:10:38,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:10:38,610 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:38,610 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,610 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:10:38,611 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,611 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 10:10:38,612 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:10:38,612 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 10:10:38,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:10:38,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:10:38,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:38,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:10:38,620 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39709,1689675027617' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-18 10:10:38,620 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7aac13c3[Count = 1] remaining members to acquire global barrier 2023-07-18 10:10:38,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:38,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:10:38,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:10:38,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:10:38,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:10:38,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:10:38,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:10:38,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:38,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:10:38,627 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43301,1689675027670' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-18 10:10:38,627 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7aac13c3[Count = 0] remaining members to acquire global barrier 2023-07-18 10:10:38,627 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-18 10:10:38,627 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,628 DEBUG [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 10:10:38,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-18 10:10:38,635 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,635 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,635 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-18 10:10:38,635 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-18 10:10:38,635 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,37417,1689675027545' in zk 2023-07-18 10:10:38,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-18 10:10:38,635 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-18 10:10:38,636 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:10:38,636 DEBUG [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-18 10:10:38,637 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,637 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,644 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 10:10:38,644 DEBUG [rs(jenkins-hbase4.apache.org,39709,1689675027617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689675037213.0bfe26a983764d2364d352c3d6776ba9. 2023-07-18 10:10:38,644 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 10:10:38,644 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:38,644 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-18 10:10:38,644 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-18 10:10:38,644 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:10:38,644 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-18 10:10:38,644 DEBUG [rs(jenkins-hbase4.apache.org,39709,1689675027617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689675037213.0bfe26a983764d2364d352c3d6776ba9. started... 2023-07-18 10:10:38,645 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-18 10:10:38,648 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 10:10:38,648 DEBUG [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689675037213.5077a43ed1e6c9611287b336eee29ba4. 2023-07-18 10:10:38,648 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 10:10:38,648 DEBUG [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689675037213.5077a43ed1e6c9611287b336eee29ba4. started... 2023-07-18 10:10:38,649 DEBUG [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5077a43ed1e6c9611287b336eee29ba4: 2023-07-18 10:10:38,649 DEBUG [rs(jenkins-hbase4.apache.org,39709,1689675027617)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0bfe26a983764d2364d352c3d6776ba9: 2023-07-18 10:10:38,651 DEBUG [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689675037213.5077a43ed1e6c9611287b336eee29ba4.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,651 DEBUG [rs(jenkins-hbase4.apache.org,39709,1689675027617)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689675037213.0bfe26a983764d2364d352c3d6776ba9.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,658 DEBUG [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 10:10:38,658 DEBUG [rs(jenkins-hbase4.apache.org,39709,1689675027617)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 10:10:38,664 DEBUG [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-18 10:10:38,664 DEBUG [rs(jenkins-hbase4.apache.org,39709,1689675027617)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-18 10:10:38,737 DEBUG [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689675037213.5077a43ed1e6c9611287b336eee29ba4. completed. 2023-07-18 10:10:38,737 DEBUG [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689675037213.5077a43ed1e6c9611287b336eee29ba4. 2023-07-18 10:10:38,737 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 10:10:38,737 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 10:10:38,737 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:38,738 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-18 10:10:38,738 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,43301,1689675027670' in zk 2023-07-18 10:10:38,738 DEBUG [rs(jenkins-hbase4.apache.org,39709,1689675027617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689675037213.0bfe26a983764d2364d352c3d6776ba9. completed. 2023-07-18 10:10:38,738 DEBUG [rs(jenkins-hbase4.apache.org,39709,1689675027617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689675037213.0bfe26a983764d2364d352c3d6776ba9. 2023-07-18 10:10:38,738 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 10:10:38,738 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 10:10:38,738 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:10:38,738 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-18 10:10:38,738 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,39709,1689675027617' in zk 2023-07-18 10:10:38,740 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:38,740 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-18 10:10:38,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:38,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:10:38,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:10:38,740 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:10:38,740 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-18 10:10:38,741 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-18 10:10:38,741 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:10:38,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:10:38,741 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:10:38,741 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-18 10:10:38,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:10:38,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:10:38,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:10:38,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:38,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:10:38,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:10:38,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:10:38,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:38,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,43301,1689675027670': 2023-07-18 10:10:38,749 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43301,1689675027670' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-18 10:10:38,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:10:38,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:10:38,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:10:38,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:10:38,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:10:38,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:10:38,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:10:38,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:38,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:10:38,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:10:38,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:10:38,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:38,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,39709,1689675027617': 2023-07-18 10:10:38,754 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39709,1689675027617' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-18 10:10:38,754 INFO [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-18 10:10:38,754 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-18 10:10:38,754 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-18 10:10:38,754 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,754 INFO [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-18 10:10:38,758 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,758 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,758 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,758 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,758 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:10:38,758 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,758 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,758 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:10:38,758 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,758 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:10:38,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:10:38,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:10:38,759 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:10:38,759 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:10:38,759 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:10:38,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:10:38,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:10:38,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:10:38,760 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:10:38,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:10:38,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,760 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:10:38,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:10:38,761 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:38,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:10:38,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:10:38,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:38,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:10:38,763 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:10:38,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,764 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:10:38,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:10:38,764 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:38,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:10:38,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:38,779 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:38,779 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,779 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:10:38,779 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:10:38,779 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,779 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:10:38,779 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:10:38,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:10:38,780 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:10:38,780 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:10:38,780 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:10:38,780 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:10:38,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:10:38,780 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:10:38,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:10:38,780 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:10:38,780 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:10:38,781 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:38,781 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:10:38,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:10:38,781 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,781 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:10:38,781 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,781 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:10:38,781 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-18 10:10:38,781 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:10:38,783 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,783 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,783 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,783 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-18 10:10:38,783 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:10:38,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:10:38,784 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:10:38,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:10:38,784 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-18 10:10:38,809 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,814 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,839 DEBUG [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 10:10:38,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-18 10:10:38,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-18 10:10:38,841 DEBUG [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-18 10:10:38,880 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,915 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-18 10:10:38,916 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,916 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:38,917 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689675038519Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1689675038809 (+290 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1689675038809Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1689675038809Writing data manifest for emptySnaptb0-testExportWithTargetName at 1689675038833 (+24 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1689675038866 (+33 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689675038915 (+49 ms) 2023-07-18 10:10:38,918 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-18 10:10:38,921 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 397 msec 2023-07-18 10:10:39,141 DEBUG [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 10:10:39,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-18 10:10:39,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-18 10:10:39,157 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43301] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1689675037213.5077a43ed1e6c9611287b336eee29ba4. with WAL disabled. Data may be lost in the event of a crash. 2023-07-18 10:10:39,159 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39709] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1689675037213.0bfe26a983764d2364d352c3d6776ba9. with WAL disabled. Data may be lost in the event of a crash. 2023-07-18 10:10:39,163 DEBUG [Listener at jenkins-hbase4.apache.org/34477] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-18 10:10:39,163 DEBUG [Listener at jenkins-hbase4.apache.org/34477] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689675037213.5077a43ed1e6c9611287b336eee29ba4. 2023-07-18 10:10:39,163 INFO [Listener at jenkins-hbase4.apache.org/34477] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 10:10:39,178 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-18 10:10:39,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689675039178 (current time:1689675039178). 2023-07-18 10:10:39,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-18 10:10:39,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] zookeeper.ReadOnlyZKClient(139): Connect 0x73cd7958 to 127.0.0.1:60990 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 10:10:39,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5e2af72a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 10:10:39,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 10:10:39,189 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56128, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 10:10:39,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x73cd7958 to 127.0.0.1:60990 2023-07-18 10:10:39,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 10:10:39,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] zookeeper.ReadOnlyZKClient(139): Connect 0x5c375966 to 127.0.0.1:60990 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 10:10:39,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@44a8fc01, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 10:10:39,196 DEBUG [hconnection-0x4d32c019-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 10:10:39,199 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56140, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 10:10:39,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 10:10:39,204 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37822, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 10:10:39,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5c375966 to 127.0.0.1:60990 2023-07-18 10:10:39,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 10:10:39,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-18 10:10:39,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-18 10:10:39,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-18 10:10:39,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-18 10:10:39,210 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-18 10:10:39,211 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689675639211 2023-07-18 10:10:39,211 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-18 10:10:39,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-18 10:10:39,212 DEBUG [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-18 10:10:39,212 DEBUG [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-18 10:10:39,213 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-18 10:10:39,214 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-18 10:10:39,215 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 5 msec 2023-07-18 10:10:39,216 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-18 10:10:39,217 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689675639217 2023-07-18 10:10:39,239 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-18 10:10:39,239 INFO [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-18 10:10:39,239 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:10:39,240 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-18 10:10:39,240 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-18 10:10:39,240 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 10:10:39,241 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-18 10:10:39,242 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:10:39,242 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:10:39,242 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:10:39,242 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:10:39,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:10:39,242 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:39,242 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:10:39,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:10:39,242 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:10:39,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:10:39,243 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:39,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-18 10:10:39,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-18 10:10:39,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-18 10:10:39,243 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:10:39,243 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 10:10:39,243 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 10:10:39,243 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 10:10:39,243 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:10:39,244 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-18 10:10:39,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-18 10:10:39,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-18 10:10:39,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-18 10:10:39,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-18 10:10:39,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-18 10:10:39,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-18 10:10:39,244 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-18 10:10:39,244 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-18 10:10:39,244 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-18 10:10:39,244 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-18 10:10:39,244 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-18 10:10:39,244 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-18 10:10:39,244 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-18 10:10:39,244 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:10:39,244 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-18 10:10:39,245 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-18 10:10:39,245 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-18 10:10:39,244 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:10:39,245 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:10:39,245 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-18 10:10:39,247 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-18 10:10:39,247 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-18 10:10:39,247 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39709,1689675027617' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-18 10:10:39,246 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-18 10:10:39,247 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-18 10:10:39,247 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43301,1689675027670' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-18 10:10:39,247 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37417,1689675027545' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-18 10:10:39,249 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:10:39,249 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 10:10:39,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:10:39,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:10:39,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:10:39,249 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 10:10:39,251 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 10:10:39,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:10:39,251 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 10:10:39,251 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:39,251 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 10:10:39,252 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 10:10:39,251 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 10:10:39,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:10:39,252 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 10:10:39,252 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 10:10:39,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-18 10:10:39,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:10:39,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:10:39,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:39,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:10:39,253 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39709,1689675027617' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-18 10:10:39,253 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@681912ce[Count = 1] remaining members to acquire global barrier 2023-07-18 10:10:39,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:39,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:10:39,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:10:39,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:10:39,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:10:39,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-18 10:10:39,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:10:39,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:10:39,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:39,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:10:39,256 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43301,1689675027670' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-18 10:10:39,256 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@681912ce[Count = 0] remaining members to acquire global barrier 2023-07-18 10:10:39,256 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-18 10:10:39,256 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 10:10:39,260 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 10:10:39,260 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 10:10:39,260 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 10:10:39,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 10:10:39,260 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 10:10:39,260 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-18 10:10:39,260 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:10:39,260 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 10:10:39,260 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 10:10:39,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 10:10:39,260 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-18 10:10:39,260 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-18 10:10:39,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 10:10:39,260 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,37417,1689675027545' in zk 2023-07-18 10:10:39,261 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:39,261 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 10:10:39,261 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 10:10:39,261 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-18 10:10:39,260 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-18 10:10:39,261 DEBUG [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689675037213.5077a43ed1e6c9611287b336eee29ba4. 2023-07-18 10:10:39,261 DEBUG [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689675037213.5077a43ed1e6c9611287b336eee29ba4. started... 2023-07-18 10:10:39,261 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 10:10:39,261 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 10:10:39,261 DEBUG [rs(jenkins-hbase4.apache.org,39709,1689675027617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689675037213.0bfe26a983764d2364d352c3d6776ba9. 2023-07-18 10:10:39,261 INFO [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 5077a43ed1e6c9611287b336eee29ba4 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-18 10:10:39,261 DEBUG [rs(jenkins-hbase4.apache.org,39709,1689675027617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689675037213.0bfe26a983764d2364d352c3d6776ba9. started... 2023-07-18 10:10:39,261 INFO [rs(jenkins-hbase4.apache.org,39709,1689675027617)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 0bfe26a983764d2364d352c3d6776ba9 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-18 10:10:39,263 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-18 10:10:39,263 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:10:39,263 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-18 10:10:39,313 DEBUG [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 10:10:39,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-18 10:10:39,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-18 10:10:39,315 DEBUG [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-18 10:10:39,399 INFO [rs(jenkins-hbase4.apache.org,39709,1689675027617)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230718fee76273aabb458eb4206a873fb44ae9 to hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230718fee76273aabb458eb4206a873fb44ae9 2023-07-18 10:10:39,399 INFO [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023071878104b1eaea441008d53684a30f9c122 to hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023071878104b1eaea441008d53684a30f9c122 2023-07-18 10:10:39,433 INFO [rs(jenkins-hbase4.apache.org,39709,1689675027617)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportWithTargetName/0bfe26a983764d2364d352c3d6776ba9/.tmp/cf/6130b6b164944eba8570429097b67772 2023-07-18 10:10:39,433 INFO [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportWithTargetName/5077a43ed1e6c9611287b336eee29ba4/.tmp/cf/835fa52429d5419d81a43e6e4761996a 2023-07-18 10:10:39,444 DEBUG [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportWithTargetName/5077a43ed1e6c9611287b336eee29ba4/.tmp/cf/835fa52429d5419d81a43e6e4761996a as hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportWithTargetName/5077a43ed1e6c9611287b336eee29ba4/cf/835fa52429d5419d81a43e6e4761996a 2023-07-18 10:10:39,444 DEBUG [rs(jenkins-hbase4.apache.org,39709,1689675027617)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportWithTargetName/0bfe26a983764d2364d352c3d6776ba9/.tmp/cf/6130b6b164944eba8570429097b67772 as hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportWithTargetName/0bfe26a983764d2364d352c3d6776ba9/cf/6130b6b164944eba8570429097b67772 2023-07-18 10:10:39,453 INFO [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportWithTargetName/5077a43ed1e6c9611287b336eee29ba4/cf/835fa52429d5419d81a43e6e4761996a, entries=5, sequenceid=6, filesize=5.7 K 2023-07-18 10:10:39,455 INFO [rs(jenkins-hbase4.apache.org,39709,1689675027617)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportWithTargetName/0bfe26a983764d2364d352c3d6776ba9/cf/6130b6b164944eba8570429097b67772, entries=45, sequenceid=6, filesize=12.5 K 2023-07-18 10:10:39,458 INFO [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 5077a43ed1e6c9611287b336eee29ba4 in 197ms, sequenceid=6, compaction requested=false 2023-07-18 10:10:39,458 INFO [rs(jenkins-hbase4.apache.org,39709,1689675027617)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 0bfe26a983764d2364d352c3d6776ba9 in 197ms, sequenceid=6, compaction requested=false 2023-07-18 10:10:39,458 DEBUG [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-18 10:10:39,458 DEBUG [rs(jenkins-hbase4.apache.org,39709,1689675027617)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-18 10:10:39,460 DEBUG [rs(jenkins-hbase4.apache.org,39709,1689675027617)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0bfe26a983764d2364d352c3d6776ba9: 2023-07-18 10:10:39,460 DEBUG [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5077a43ed1e6c9611287b336eee29ba4: 2023-07-18 10:10:39,461 DEBUG [rs(jenkins-hbase4.apache.org,39709,1689675027617)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689675037213.0bfe26a983764d2364d352c3d6776ba9.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-18 10:10:39,461 DEBUG [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689675037213.5077a43ed1e6c9611287b336eee29ba4.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-18 10:10:39,461 DEBUG [rs(jenkins-hbase4.apache.org,39709,1689675027617)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 10:10:39,461 DEBUG [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 10:10:39,461 DEBUG [rs(jenkins-hbase4.apache.org,39709,1689675027617)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportWithTargetName/0bfe26a983764d2364d352c3d6776ba9/cf/6130b6b164944eba8570429097b67772] hfiles 2023-07-18 10:10:39,461 DEBUG [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportWithTargetName/5077a43ed1e6c9611287b336eee29ba4/cf/835fa52429d5419d81a43e6e4761996a] hfiles 2023-07-18 10:10:39,461 DEBUG [rs(jenkins-hbase4.apache.org,39709,1689675027617)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportWithTargetName/0bfe26a983764d2364d352c3d6776ba9/cf/6130b6b164944eba8570429097b67772 for snapshot=snaptb0-testExportWithTargetName 2023-07-18 10:10:39,461 DEBUG [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportWithTargetName/5077a43ed1e6c9611287b336eee29ba4/cf/835fa52429d5419d81a43e6e4761996a for snapshot=snaptb0-testExportWithTargetName 2023-07-18 10:10:39,484 DEBUG [rs(jenkins-hbase4.apache.org,39709,1689675027617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689675037213.0bfe26a983764d2364d352c3d6776ba9. completed. 2023-07-18 10:10:39,484 DEBUG [rs(jenkins-hbase4.apache.org,39709,1689675027617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689675037213.0bfe26a983764d2364d352c3d6776ba9. 2023-07-18 10:10:39,484 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 10:10:39,484 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 10:10:39,484 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:10:39,484 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-18 10:10:39,484 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,39709,1689675027617' in zk 2023-07-18 10:10:39,485 DEBUG [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689675037213.5077a43ed1e6c9611287b336eee29ba4. completed. 2023-07-18 10:10:39,485 DEBUG [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689675037213.5077a43ed1e6c9611287b336eee29ba4. 2023-07-18 10:10:39,485 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 10:10:39,485 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 10:10:39,485 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:39,485 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-18 10:10:39,485 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,43301,1689675027670' in zk 2023-07-18 10:10:39,487 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:10:39,487 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-18 10:10:39,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:10:39,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:10:39,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:10:39,487 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:10:39,488 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-18 10:10:39,489 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:39,489 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-18 10:10:39,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:10:39,489 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:10:39,489 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-18 10:10:39,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:10:39,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-18 10:10:39,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:10:39,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:10:39,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:39,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:10:39,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-18 10:10:39,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:10:39,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:10:39,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:39,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,39709,1689675027617': 2023-07-18 10:10:39,494 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39709,1689675027617' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-18 10:10:39,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:39,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:10:39,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:10:39,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:10:39,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:10:39,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-18 10:10:39,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:10:39,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:10:39,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:39,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:10:39,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-18 10:10:39,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:10:39,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:10:39,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:39,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,43301,1689675027670': 2023-07-18 10:10:39,498 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43301,1689675027670' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-18 10:10:39,498 INFO [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-18 10:10:39,498 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-18 10:10:39,498 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-18 10:10:39,498 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-18 10:10:39,498 INFO [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-18 10:10:39,500 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 10:10:39,500 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 10:10:39,500 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:10:39,500 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:10:39,500 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 10:10:39,500 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 10:10:39,500 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 10:10:39,500 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 10:10:39,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 10:10:39,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:10:39,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:10:39,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 10:10:39,500 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:10:39,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 10:10:39,501 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:10:39,500 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 10:10:39,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 10:10:39,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:10:39,501 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:10:39,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:10:39,501 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:10:39,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:10:39,501 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:10:39,501 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:10:39,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:10:39,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-18 10:10:39,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 10:10:39,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 10:10:39,502 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:39,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 10:10:39,504 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:10:39,504 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:10:39,505 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:39,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:10:39,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-18 10:10:39,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:10:39,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:10:39,514 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:39,514 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-18 10:10:39,514 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:10:39,514 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:10:39,515 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:10:39,514 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:10:39,515 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-18 10:10:39,515 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:10:39,515 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-18 10:10:39,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:39,515 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:10:39,515 DEBUG [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 10:10:39,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:10:39,515 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:10:39,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:10:39,515 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:10:39,515 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:10:39,515 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:10:39,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:10:39,515 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-18 10:10:39,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:10:39,516 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-18 10:10:39,515 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-18 10:10:39,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:10:39,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:10:39,516 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:10:39,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:10:39,516 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:39,517 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 10:10:39,517 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:10:39,517 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:10:39,517 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName because node does not exist (not an error) 2023-07-18 10:10:39,517 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 10:10:39,517 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:10:39,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:10:39,517 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 10:10:39,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-18 10:10:39,517 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:10:39,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-18 10:10:39,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:10:39,518 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230718fee76273aabb458eb4206a873fb44ae9, hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023071878104b1eaea441008d53684a30f9c122] mob files 2023-07-18 10:10:39,518 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230718fee76273aabb458eb4206a873fb44ae9 2023-07-18 10:10:39,518 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023071878104b1eaea441008d53684a30f9c122 2023-07-18 10:10:39,518 DEBUG [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-18 10:10:39,546 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-18 10:10:39,547 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-18 10:10:39,585 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-18 10:10:39,628 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-18 10:10:39,628 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-18 10:10:39,629 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-18 10:10:39,629 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689675039211Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1689675039546 (+335 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1689675039546Loading Region manifests for snaptb0-testExportWithTargetName at 1689675039546Writing data manifest for snaptb0-testExportWithTargetName at 1689675039553 (+7 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1689675039573 (+20 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689675039628 (+55 ms) 2023-07-18 10:10:39,631 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-18 10:10:39,633 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 419 msec 2023-07-18 10:10:39,819 DEBUG [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 10:10:39,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-18 10:10:39,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-18 10:10:39,823 INFO [Listener at jenkins-hbase4.apache.org/34477] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/export-test/export-1689675039823 2023-07-18 10:10:39,823 INFO [Listener at jenkins-hbase4.apache.org/34477] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:44811, tgtDir=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/export-test/export-1689675039823, rawTgtDir=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/export-test/export-1689675039823, srcFsUri=hdfs://localhost:44811, srcDir=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427 2023-07-18 10:10:39,874 DEBUG [Listener at jenkins-hbase4.apache.org/34477] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44811, inputRoot=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427 2023-07-18 10:10:39,874 DEBUG [Listener at jenkins-hbase4.apache.org/34477] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-931653706_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/export-test/export-1689675039823, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/export-test/export-1689675039823/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-18 10:10:39,874 INFO [Listener at jenkins-hbase4.apache.org/34477] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44811, inputRoot=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427, snapshotDir=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-18 10:10:39,899 INFO [Listener at jenkins-hbase4.apache.org/34477] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/export-test/export-1689675039823/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-18 10:10:40,031 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-18 10:10:40,032 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-18 10:10:40,034 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-18 10:10:40,034 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-18 10:10:40,035 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-18 10:10:40,035 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-18 10:10:40,035 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-18 10:10:40,129 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c329d283-1f43-4a99-3860-7ed90b9830ca/hadoop-3510240142400487596.jar 2023-07-18 10:10:40,130 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-18 10:10:40,130 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-18 10:10:40,131 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-18 10:10:40,131 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-18 10:10:40,132 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-18 10:10:40,132 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-18 10:10:40,133 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-18 10:10:40,134 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-18 10:10:40,134 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-18 10:10:40,135 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-18 10:10:40,136 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-18 10:10:40,136 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-18 10:10:40,137 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-18 10:10:40,137 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-18 10:10:40,138 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-18 10:10:40,139 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-18 10:10:40,142 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 10:10:40,143 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 10:10:40,143 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 10:10:40,143 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 10:10:40,144 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 10:10:40,144 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 10:10:40,144 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 10:10:41,590 WARN [Listener at jenkins-hbase4.apache.org/34477] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-18 10:10:41,596 INFO [Listener at jenkins-hbase4.apache.org/34477] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-18 10:10:41,607 DEBUG [Listener at jenkins-hbase4.apache.org/34477] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-18 10:10:42,069 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 10:10:42,071 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 10:10:42,389 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689675035640_0001_000001 (auth:SIMPLE) 2023-07-18 10:10:43,228 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-18 10:10:47,566 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689675035640_0001_000001 (auth:SIMPLE) 2023-07-18 10:10:49,850 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689675035640_0001_000001 (auth:SIMPLE) 2023-07-18 10:10:53,660 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689675035640_0001_000001 (auth:SIMPLE) 2023-07-18 10:10:55,524 INFO [Listener at jenkins-hbase4.apache.org/34477] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-18 10:10:55,526 INFO [Listener at jenkins-hbase4.apache.org/34477] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-18 10:10:55,537 INFO [Listener at jenkins-hbase4.apache.org/34477] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-18 10:10:55,537 INFO [Listener at jenkins-hbase4.apache.org/34477] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-18 10:10:55,538 INFO [Listener at jenkins-hbase4.apache.org/34477] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-18 10:10:55,538 DEBUG [Listener at jenkins-hbase4.apache.org/34477] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_307542026_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-18 10:10:55,538 DEBUG [Listener at jenkins-hbase4.apache.org/34477] snapshot.TestExportSnapshot(367): hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-18 10:10:55,538 DEBUG [Listener at jenkins-hbase4.apache.org/34477] snapshot.TestExportSnapshot(367): hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-18 10:10:55,538 DEBUG [Listener at jenkins-hbase4.apache.org/34477] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_307542026_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/export-test/export-1689675039823/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/export-test/export-1689675039823/.hbase-snapshot/testExportWithTargetName 2023-07-18 10:10:55,539 DEBUG [Listener at jenkins-hbase4.apache.org/34477] snapshot.TestExportSnapshot(367): hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/export-test/export-1689675039823/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-18 10:10:55,539 DEBUG [Listener at jenkins-hbase4.apache.org/34477] snapshot.TestExportSnapshot(367): hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/export-test/export-1689675039823/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-18 10:10:55,549 INFO [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-18 10:10:55,554 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-07-18 10:10:55,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-18 10:10:55,567 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689675055567"}]},"ts":"1689675055567"} 2023-07-18 10:10:55,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-18 10:10:55,569 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-18 10:10:55,570 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-18 10:10:55,572 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5077a43ed1e6c9611287b336eee29ba4, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=0bfe26a983764d2364d352c3d6776ba9, UNASSIGN}] 2023-07-18 10:10:55,574 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5077a43ed1e6c9611287b336eee29ba4, UNASSIGN 2023-07-18 10:10:55,574 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=0bfe26a983764d2364d352c3d6776ba9, UNASSIGN 2023-07-18 10:10:55,575 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=5077a43ed1e6c9611287b336eee29ba4, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:55,575 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=0bfe26a983764d2364d352c3d6776ba9, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:10:55,575 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689675037213.5077a43ed1e6c9611287b336eee29ba4.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689675055575"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689675055575"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689675055575"}]},"ts":"1689675055575"} 2023-07-18 10:10:55,575 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689675037213.0bfe26a983764d2364d352c3d6776ba9.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689675055575"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689675055575"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689675055575"}]},"ts":"1689675055575"} 2023-07-18 10:10:55,577 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE; CloseRegionProcedure 0bfe26a983764d2364d352c3d6776ba9, server=jenkins-hbase4.apache.org,39709,1689675027617}] 2023-07-18 10:10:55,578 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=22, state=RUNNABLE; CloseRegionProcedure 5077a43ed1e6c9611287b336eee29ba4, server=jenkins-hbase4.apache.org,43301,1689675027670}] 2023-07-18 10:10:55,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-18 10:10:55,747 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 0bfe26a983764d2364d352c3d6776ba9 2023-07-18 10:10:55,747 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 5077a43ed1e6c9611287b336eee29ba4 2023-07-18 10:10:55,747 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0bfe26a983764d2364d352c3d6776ba9, disabling compactions & flushes 2023-07-18 10:10:55,747 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5077a43ed1e6c9611287b336eee29ba4, disabling compactions & flushes 2023-07-18 10:10:55,747 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689675037213.0bfe26a983764d2364d352c3d6776ba9. 2023-07-18 10:10:55,747 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689675037213.5077a43ed1e6c9611287b336eee29ba4. 2023-07-18 10:10:55,747 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689675037213.0bfe26a983764d2364d352c3d6776ba9. 2023-07-18 10:10:55,747 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689675037213.5077a43ed1e6c9611287b336eee29ba4. 2023-07-18 10:10:55,747 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689675037213.0bfe26a983764d2364d352c3d6776ba9. after waiting 0 ms 2023-07-18 10:10:55,747 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689675037213.5077a43ed1e6c9611287b336eee29ba4. after waiting 0 ms 2023-07-18 10:10:55,747 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689675037213.0bfe26a983764d2364d352c3d6776ba9. 2023-07-18 10:10:55,747 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689675037213.5077a43ed1e6c9611287b336eee29ba4. 2023-07-18 10:10:55,779 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportWithTargetName/5077a43ed1e6c9611287b336eee29ba4/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-18 10:10:55,779 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportWithTargetName/0bfe26a983764d2364d352c3d6776ba9/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-18 10:10:55,779 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 10:10:55,780 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 10:10:55,782 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689675037213.0bfe26a983764d2364d352c3d6776ba9. 2023-07-18 10:10:55,782 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689675037213.5077a43ed1e6c9611287b336eee29ba4. 2023-07-18 10:10:55,782 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0bfe26a983764d2364d352c3d6776ba9: 2023-07-18 10:10:55,782 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5077a43ed1e6c9611287b336eee29ba4: 2023-07-18 10:10:55,784 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 5077a43ed1e6c9611287b336eee29ba4 2023-07-18 10:10:55,785 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=5077a43ed1e6c9611287b336eee29ba4, regionState=CLOSED 2023-07-18 10:10:55,785 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689675037213.5077a43ed1e6c9611287b336eee29ba4.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689675055785"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689675055785"}]},"ts":"1689675055785"} 2023-07-18 10:10:55,785 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 0bfe26a983764d2364d352c3d6776ba9 2023-07-18 10:10:55,786 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=0bfe26a983764d2364d352c3d6776ba9, regionState=CLOSED 2023-07-18 10:10:55,786 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689675037213.0bfe26a983764d2364d352c3d6776ba9.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689675055786"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689675055786"}]},"ts":"1689675055786"} 2023-07-18 10:10:55,794 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=22 2023-07-18 10:10:55,794 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=22, state=SUCCESS; CloseRegionProcedure 5077a43ed1e6c9611287b336eee29ba4, server=jenkins-hbase4.apache.org,43301,1689675027670 in 213 msec 2023-07-18 10:10:55,795 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=23 2023-07-18 10:10:55,795 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=23, state=SUCCESS; CloseRegionProcedure 0bfe26a983764d2364d352c3d6776ba9, server=jenkins-hbase4.apache.org,39709,1689675027617 in 215 msec 2023-07-18 10:10:55,796 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5077a43ed1e6c9611287b336eee29ba4, UNASSIGN in 222 msec 2023-07-18 10:10:55,797 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=21 2023-07-18 10:10:55,797 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=0bfe26a983764d2364d352c3d6776ba9, UNASSIGN in 223 msec 2023-07-18 10:10:55,798 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689675055798"}]},"ts":"1689675055798"} 2023-07-18 10:10:55,800 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-18 10:10:55,802 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-18 10:10:55,805 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 247 msec 2023-07-18 10:10:55,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-18 10:10:55,870 INFO [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-18 10:10:55,877 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-07-18 10:10:55,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-18 10:10:55,887 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-18 10:10:55,888 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-18 10:10:55,889 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-18 10:10:55,892 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43301] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-18 10:10:55,895 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-18 10:10:55,895 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-18 10:10:55,895 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-18 10:10:55,895 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-18 10:10:55,896 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportWithTargetName/5077a43ed1e6c9611287b336eee29ba4 2023-07-18 10:10:55,896 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportWithTargetName/0bfe26a983764d2364d352c3d6776ba9 2023-07-18 10:10:55,897 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:10:55,897 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:10:55,897 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-18 10:10:55,897 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-18 10:10:55,897 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:10:55,897 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-18 10:10:55,897 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-18 10:10:55,897 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-18 10:10:55,897 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:10:55,897 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-18 10:10:55,897 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-18 10:10:55,897 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-18 10:10:55,900 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportWithTargetName/0bfe26a983764d2364d352c3d6776ba9/cf, FileablePath, hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportWithTargetName/0bfe26a983764d2364d352c3d6776ba9/recovered.edits] 2023-07-18 10:10:55,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-18 10:10:55,900 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportWithTargetName/5077a43ed1e6c9611287b336eee29ba4/cf, FileablePath, hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportWithTargetName/5077a43ed1e6c9611287b336eee29ba4/recovered.edits] 2023-07-18 10:10:55,908 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportWithTargetName/0bfe26a983764d2364d352c3d6776ba9/cf/6130b6b164944eba8570429097b67772 to hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/archive/data/default/testtb-testExportWithTargetName/0bfe26a983764d2364d352c3d6776ba9/cf/6130b6b164944eba8570429097b67772 2023-07-18 10:10:55,908 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportWithTargetName/5077a43ed1e6c9611287b336eee29ba4/cf/835fa52429d5419d81a43e6e4761996a to hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/archive/data/default/testtb-testExportWithTargetName/5077a43ed1e6c9611287b336eee29ba4/cf/835fa52429d5419d81a43e6e4761996a 2023-07-18 10:10:55,914 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportWithTargetName/5077a43ed1e6c9611287b336eee29ba4/recovered.edits/9.seqid to hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/archive/data/default/testtb-testExportWithTargetName/5077a43ed1e6c9611287b336eee29ba4/recovered.edits/9.seqid 2023-07-18 10:10:55,915 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportWithTargetName/5077a43ed1e6c9611287b336eee29ba4 2023-07-18 10:10:55,915 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportWithTargetName/0bfe26a983764d2364d352c3d6776ba9/recovered.edits/9.seqid to hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/archive/data/default/testtb-testExportWithTargetName/0bfe26a983764d2364d352c3d6776ba9/recovered.edits/9.seqid 2023-07-18 10:10:55,916 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportWithTargetName/0bfe26a983764d2364d352c3d6776ba9 2023-07-18 10:10:55,916 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-18 10:10:55,916 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-18 10:10:55,917 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-07-18 10:10:55,921 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230718fee76273aabb458eb4206a873fb44ae9 to hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230718fee76273aabb458eb4206a873fb44ae9 2023-07-18 10:10:55,922 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023071878104b1eaea441008d53684a30f9c122 to hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023071878104b1eaea441008d53684a30f9c122 2023-07-18 10:10:55,923 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-18 10:10:55,926 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-18 10:10:55,946 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-18 10:10:55,949 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-18 10:10:55,951 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-18 10:10:55,951 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-18 10:10:55,951 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1689675037213.5077a43ed1e6c9611287b336eee29ba4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689675055951"}]},"ts":"9223372036854775807"} 2023-07-18 10:10:55,951 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1689675037213.0bfe26a983764d2364d352c3d6776ba9.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689675055951"}]},"ts":"9223372036854775807"} 2023-07-18 10:10:55,953 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-18 10:10:55,953 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 5077a43ed1e6c9611287b336eee29ba4, NAME => 'testtb-testExportWithTargetName,,1689675037213.5077a43ed1e6c9611287b336eee29ba4.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 0bfe26a983764d2364d352c3d6776ba9, NAME => 'testtb-testExportWithTargetName,1,1689675037213.0bfe26a983764d2364d352c3d6776ba9.', STARTKEY => '1', ENDKEY => ''}] 2023-07-18 10:10:55,953 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-18 10:10:55,953 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689675055953"}]},"ts":"9223372036854775807"} 2023-07-18 10:10:55,955 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-18 10:10:55,958 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-18 10:10:55,960 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 80 msec 2023-07-18 10:10:56,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-18 10:10:56,004 INFO [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-18 10:10:56,022 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-18 10:10:56,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-18 10:10:56,027 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-07-18 10:10:56,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-18 10:10:56,059 INFO [Listener at jenkins-hbase4.apache.org/34477] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=753 (was 705) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_307542026_17 at /127.0.0.1:42982 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1988502388) connection to jenkins-hbase4.apache.org/172.31.14.131:37531 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c329d283-1f43-4a99-3860-7ed90b9830ca/cluster_838469a3-f099-4817-4d19-bba87533c742/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1988502388) connection to jenkins-hbase4.apache.org/172.31.14.131:35877 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x36ae74de-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c329d283-1f43-4a99-3860-7ed90b9830ca/cluster_838469a3-f099-4817-4d19-bba87533c742/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c329d283-1f43-4a99-3860-7ed90b9830ca/cluster_838469a3-f099-4817-4d19-bba87533c742/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1988502388) connection to jenkins-hbase4.apache.org/172.31.14.131:38507 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1314 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x36ae74de-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x36ae74de-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-931653706_17 at /127.0.0.1:52444 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c329d283-1f43-4a99-3860-7ed90b9830ca/cluster_838469a3-f099-4817-4d19-bba87533c742/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x36ae74de-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-734456677_1 at /127.0.0.1:52422 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-734456677_1 at /127.0.0.1:42960 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c329d283-1f43-4a99-3860-7ed90b9830ca/cluster_838469a3-f099-4817-4d19-bba87533c742/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_307542026_17 at /127.0.0.1:53282 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c329d283-1f43-4a99-3860-7ed90b9830ca/cluster_838469a3-f099-4817-4d19-bba87533c742/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=929 (was 901) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=351 (was 321) - SystemLoadAverage LEAK? -, ProcessCount=183 (was 178) - ProcessCount LEAK? -, AvailableMemoryMB=3213 (was 4831) 2023-07-18 10:10:56,060 WARN [Listener at jenkins-hbase4.apache.org/34477] hbase.ResourceChecker(130): Thread=753 is superior to 500 2023-07-18 10:10:56,081 INFO [Listener at jenkins-hbase4.apache.org/34477] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=753, OpenFileDescriptor=929, MaxFileDescriptor=60000, SystemLoadAverage=351, ProcessCount=183, AvailableMemoryMB=3211 2023-07-18 10:10:56,081 WARN [Listener at jenkins-hbase4.apache.org/34477] hbase.ResourceChecker(130): Thread=753 is superior to 500 2023-07-18 10:10:56,083 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-18 10:10:56,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-18 10:10:56,089 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-18 10:10:56,090 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-18 10:10:56,091 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-18 10:10:56,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-18 10:10:56,095 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportFileSystemState/d1bc758be2ae2e38d5736c4edddf02cf 2023-07-18 10:10:56,095 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportFileSystemState/9767db7223bd0efb3bac3fb4df881c98 2023-07-18 10:10:56,095 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportFileSystemState/d1bc758be2ae2e38d5736c4edddf02cf empty. 2023-07-18 10:10:56,095 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportFileSystemState/9767db7223bd0efb3bac3fb4df881c98 empty. 2023-07-18 10:10:56,096 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportFileSystemState/9767db7223bd0efb3bac3fb4df881c98 2023-07-18 10:10:56,096 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportFileSystemState/d1bc758be2ae2e38d5736c4edddf02cf 2023-07-18 10:10:56,096 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-18 10:10:56,110 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-18 10:10:56,112 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => d1bc758be2ae2e38d5736c4edddf02cf, NAME => 'testtb-testExportFileSystemState,,1689675056083.d1bc758be2ae2e38d5736c4edddf02cf.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp 2023-07-18 10:10:56,112 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 9767db7223bd0efb3bac3fb4df881c98, NAME => 'testtb-testExportFileSystemState,1,1689675056083.9767db7223bd0efb3bac3fb4df881c98.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp 2023-07-18 10:10:56,144 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689675056083.9767db7223bd0efb3bac3fb4df881c98.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 10:10:56,144 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689675056083.d1bc758be2ae2e38d5736c4edddf02cf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 10:10:56,145 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 9767db7223bd0efb3bac3fb4df881c98, disabling compactions & flushes 2023-07-18 10:10:56,145 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing d1bc758be2ae2e38d5736c4edddf02cf, disabling compactions & flushes 2023-07-18 10:10:56,145 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689675056083.9767db7223bd0efb3bac3fb4df881c98. 2023-07-18 10:10:56,145 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689675056083.d1bc758be2ae2e38d5736c4edddf02cf. 2023-07-18 10:10:56,146 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689675056083.9767db7223bd0efb3bac3fb4df881c98. 2023-07-18 10:10:56,146 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689675056083.d1bc758be2ae2e38d5736c4edddf02cf. 2023-07-18 10:10:56,146 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689675056083.9767db7223bd0efb3bac3fb4df881c98. after waiting 0 ms 2023-07-18 10:10:56,146 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689675056083.d1bc758be2ae2e38d5736c4edddf02cf. after waiting 0 ms 2023-07-18 10:10:56,146 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689675056083.9767db7223bd0efb3bac3fb4df881c98. 2023-07-18 10:10:56,146 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689675056083.d1bc758be2ae2e38d5736c4edddf02cf. 2023-07-18 10:10:56,146 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689675056083.9767db7223bd0efb3bac3fb4df881c98. 2023-07-18 10:10:56,146 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689675056083.d1bc758be2ae2e38d5736c4edddf02cf. 2023-07-18 10:10:56,146 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 9767db7223bd0efb3bac3fb4df881c98: 2023-07-18 10:10:56,146 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for d1bc758be2ae2e38d5736c4edddf02cf: 2023-07-18 10:10:56,149 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-18 10:10:56,151 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689675056083.9767db7223bd0efb3bac3fb4df881c98.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689675056151"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689675056151"}]},"ts":"1689675056151"} 2023-07-18 10:10:56,152 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689675056083.d1bc758be2ae2e38d5736c4edddf02cf.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689675056151"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689675056151"}]},"ts":"1689675056151"} 2023-07-18 10:10:56,154 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-18 10:10:56,155 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-18 10:10:56,155 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689675056155"}]},"ts":"1689675056155"} 2023-07-18 10:10:56,157 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-18 10:10:56,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-18 10:10:56,372 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 10:10:56,374 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 10:10:56,374 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 10:10:56,374 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-18 10:10:56,374 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 10:10:56,374 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=d1bc758be2ae2e38d5736c4edddf02cf, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9767db7223bd0efb3bac3fb4df881c98, ASSIGN}] 2023-07-18 10:10:56,377 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9767db7223bd0efb3bac3fb4df881c98, ASSIGN 2023-07-18 10:10:56,378 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=d1bc758be2ae2e38d5736c4edddf02cf, ASSIGN 2023-07-18 10:10:56,379 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=d1bc758be2ae2e38d5736c4edddf02cf, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37417,1689675027545; forceNewPlan=false, retain=false 2023-07-18 10:10:56,379 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9767db7223bd0efb3bac3fb4df881c98, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43301,1689675027670; forceNewPlan=false, retain=false 2023-07-18 10:10:56,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-18 10:10:56,529 INFO [jenkins-hbase4:38235] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-18 10:10:56,532 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=9767db7223bd0efb3bac3fb4df881c98, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:56,532 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=d1bc758be2ae2e38d5736c4edddf02cf, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:10:56,532 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689675056083.9767db7223bd0efb3bac3fb4df881c98.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689675056532"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689675056532"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689675056532"}]},"ts":"1689675056532"} 2023-07-18 10:10:56,532 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689675056083.d1bc758be2ae2e38d5736c4edddf02cf.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689675056532"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689675056532"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689675056532"}]},"ts":"1689675056532"} 2023-07-18 10:10:56,534 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE; OpenRegionProcedure 9767db7223bd0efb3bac3fb4df881c98, server=jenkins-hbase4.apache.org,43301,1689675027670}] 2023-07-18 10:10:56,535 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure d1bc758be2ae2e38d5736c4edddf02cf, server=jenkins-hbase4.apache.org,37417,1689675027545}] 2023-07-18 10:10:56,689 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:10:56,689 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-18 10:10:56,693 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47622, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-18 10:10:56,694 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1689675056083.9767db7223bd0efb3bac3fb4df881c98. 2023-07-18 10:10:56,695 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9767db7223bd0efb3bac3fb4df881c98, NAME => 'testtb-testExportFileSystemState,1,1689675056083.9767db7223bd0efb3bac3fb4df881c98.', STARTKEY => '1', ENDKEY => ''} 2023-07-18 10:10:56,695 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1689675056083.9767db7223bd0efb3bac3fb4df881c98. service=AccessControlService 2023-07-18 10:10:56,696 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 10:10:56,696 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 9767db7223bd0efb3bac3fb4df881c98 2023-07-18 10:10:56,697 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689675056083.9767db7223bd0efb3bac3fb4df881c98.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 10:10:56,697 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9767db7223bd0efb3bac3fb4df881c98 2023-07-18 10:10:56,697 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9767db7223bd0efb3bac3fb4df881c98 2023-07-18 10:10:56,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-18 10:10:56,699 INFO [StoreOpener-9767db7223bd0efb3bac3fb4df881c98-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 9767db7223bd0efb3bac3fb4df881c98 2023-07-18 10:10:56,701 DEBUG [StoreOpener-9767db7223bd0efb3bac3fb4df881c98-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemState/9767db7223bd0efb3bac3fb4df881c98/cf 2023-07-18 10:10:56,701 DEBUG [StoreOpener-9767db7223bd0efb3bac3fb4df881c98-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemState/9767db7223bd0efb3bac3fb4df881c98/cf 2023-07-18 10:10:56,701 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1689675056083.d1bc758be2ae2e38d5736c4edddf02cf. 2023-07-18 10:10:56,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d1bc758be2ae2e38d5736c4edddf02cf, NAME => 'testtb-testExportFileSystemState,,1689675056083.d1bc758be2ae2e38d5736c4edddf02cf.', STARTKEY => '', ENDKEY => '1'} 2023-07-18 10:10:56,701 INFO [StoreOpener-9767db7223bd0efb3bac3fb4df881c98-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9767db7223bd0efb3bac3fb4df881c98 columnFamilyName cf 2023-07-18 10:10:56,702 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1689675056083.d1bc758be2ae2e38d5736c4edddf02cf. service=AccessControlService 2023-07-18 10:10:56,702 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 10:10:56,702 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState d1bc758be2ae2e38d5736c4edddf02cf 2023-07-18 10:10:56,702 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689675056083.d1bc758be2ae2e38d5736c4edddf02cf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 10:10:56,702 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d1bc758be2ae2e38d5736c4edddf02cf 2023-07-18 10:10:56,702 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d1bc758be2ae2e38d5736c4edddf02cf 2023-07-18 10:10:56,703 INFO [StoreOpener-9767db7223bd0efb3bac3fb4df881c98-1] regionserver.HStore(310): Store=9767db7223bd0efb3bac3fb4df881c98/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 10:10:56,704 INFO [StoreOpener-d1bc758be2ae2e38d5736c4edddf02cf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region d1bc758be2ae2e38d5736c4edddf02cf 2023-07-18 10:10:56,705 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemState/9767db7223bd0efb3bac3fb4df881c98 2023-07-18 10:10:56,705 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemState/9767db7223bd0efb3bac3fb4df881c98 2023-07-18 10:10:56,706 DEBUG [StoreOpener-d1bc758be2ae2e38d5736c4edddf02cf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemState/d1bc758be2ae2e38d5736c4edddf02cf/cf 2023-07-18 10:10:56,706 DEBUG [StoreOpener-d1bc758be2ae2e38d5736c4edddf02cf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemState/d1bc758be2ae2e38d5736c4edddf02cf/cf 2023-07-18 10:10:56,706 INFO [StoreOpener-d1bc758be2ae2e38d5736c4edddf02cf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d1bc758be2ae2e38d5736c4edddf02cf columnFamilyName cf 2023-07-18 10:10:56,707 INFO [StoreOpener-d1bc758be2ae2e38d5736c4edddf02cf-1] regionserver.HStore(310): Store=d1bc758be2ae2e38d5736c4edddf02cf/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 10:10:56,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9767db7223bd0efb3bac3fb4df881c98 2023-07-18 10:10:56,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemState/d1bc758be2ae2e38d5736c4edddf02cf 2023-07-18 10:10:56,710 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemState/d1bc758be2ae2e38d5736c4edddf02cf 2023-07-18 10:10:56,711 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemState/9767db7223bd0efb3bac3fb4df881c98/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 10:10:56,712 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9767db7223bd0efb3bac3fb4df881c98; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74213456, jitterRate=0.10586667060852051}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 10:10:56,712 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9767db7223bd0efb3bac3fb4df881c98: 2023-07-18 10:10:56,713 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1689675056083.9767db7223bd0efb3bac3fb4df881c98., pid=30, masterSystemTime=1689675056686 2023-07-18 10:10:56,713 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d1bc758be2ae2e38d5736c4edddf02cf 2023-07-18 10:10:56,715 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1689675056083.9767db7223bd0efb3bac3fb4df881c98. 2023-07-18 10:10:56,715 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1689675056083.9767db7223bd0efb3bac3fb4df881c98. 2023-07-18 10:10:56,716 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemState/d1bc758be2ae2e38d5736c4edddf02cf/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 10:10:56,716 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=9767db7223bd0efb3bac3fb4df881c98, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:56,716 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1689675056083.9767db7223bd0efb3bac3fb4df881c98.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689675056716"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689675056716"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689675056716"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689675056716"}]},"ts":"1689675056716"} 2023-07-18 10:10:56,716 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d1bc758be2ae2e38d5736c4edddf02cf; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61407319, jitterRate=-0.08495964109897614}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 10:10:56,716 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d1bc758be2ae2e38d5736c4edddf02cf: 2023-07-18 10:10:56,717 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1689675056083.d1bc758be2ae2e38d5736c4edddf02cf., pid=31, masterSystemTime=1689675056689 2023-07-18 10:10:56,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1689675056083.d1bc758be2ae2e38d5736c4edddf02cf. 2023-07-18 10:10:56,722 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1689675056083.d1bc758be2ae2e38d5736c4edddf02cf. 2023-07-18 10:10:56,724 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=d1bc758be2ae2e38d5736c4edddf02cf, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:10:56,725 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1689675056083.d1bc758be2ae2e38d5736c4edddf02cf.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689675056724"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689675056724"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689675056724"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689675056724"}]},"ts":"1689675056724"} 2023-07-18 10:10:56,725 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=29 2023-07-18 10:10:56,725 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=29, state=SUCCESS; OpenRegionProcedure 9767db7223bd0efb3bac3fb4df881c98, server=jenkins-hbase4.apache.org,43301,1689675027670 in 186 msec 2023-07-18 10:10:56,728 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9767db7223bd0efb3bac3fb4df881c98, ASSIGN in 351 msec 2023-07-18 10:10:56,733 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=28 2023-07-18 10:10:56,733 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure d1bc758be2ae2e38d5736c4edddf02cf, server=jenkins-hbase4.apache.org,37417,1689675027545 in 192 msec 2023-07-18 10:10:56,735 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=27 2023-07-18 10:10:56,735 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=d1bc758be2ae2e38d5736c4edddf02cf, ASSIGN in 359 msec 2023-07-18 10:10:56,736 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-18 10:10:56,737 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689675056736"}]},"ts":"1689675056736"} 2023-07-18 10:10:56,738 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-18 10:10:56,781 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-18 10:10:56,781 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-18 10:10:56,784 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43301] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-18 10:10:56,834 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:10:56,834 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:10:56,834 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:10:56,834 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:10:56,879 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-18 10:10:56,879 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-18 10:10:56,880 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-18 10:10:56,880 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-18 10:10:56,883 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 794 msec 2023-07-18 10:10:57,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-18 10:10:57,200 INFO [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-18 10:10:57,204 DEBUG [Listener at jenkins-hbase4.apache.org/34477] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-18 10:10:57,204 DEBUG [Listener at jenkins-hbase4.apache.org/34477] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689675056083.d1bc758be2ae2e38d5736c4edddf02cf. 2023-07-18 10:10:57,206 INFO [Listener at jenkins-hbase4.apache.org/34477] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 10:10:57,215 DEBUG [hconnection-0x422c7ffb-shared-pool-10] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 10:10:57,219 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47636, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 10:10:57,224 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-18 10:10:57,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689675057224 (current time:1689675057224). 2023-07-18 10:10:57,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-18 10:10:57,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] zookeeper.ReadOnlyZKClient(139): Connect 0x367647dc to 127.0.0.1:60990 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 10:10:57,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@471bdc86, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 10:10:57,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 10:10:57,297 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54418, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 10:10:57,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x367647dc to 127.0.0.1:60990 2023-07-18 10:10:57,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 10:10:57,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] zookeeper.ReadOnlyZKClient(139): Connect 0x3f0edebd to 127.0.0.1:60990 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 10:10:57,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3b423627, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 10:10:57,420 DEBUG [hconnection-0x22242225-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 10:10:57,424 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54430, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 10:10:57,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 10:10:57,429 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53606, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 10:10:57,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3f0edebd to 127.0.0.1:60990 2023-07-18 10:10:57,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 10:10:57,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-18 10:10:57,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-18 10:10:57,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-18 10:10:57,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-18 10:10:57,436 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-18 10:10:57,437 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689675657437 2023-07-18 10:10:57,437 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-18 10:10:57,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-18 10:10:57,438 DEBUG [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-18 10:10:57,438 DEBUG [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-18 10:10:57,439 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-18 10:10:57,440 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-18 10:10:57,441 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-07-18 10:10:57,442 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-18 10:10:57,443 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689675657443 2023-07-18 10:10:57,458 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:57,458 INFO [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-18 10:10:57,458 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:10:57,459 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-18 10:10:57,459 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-18 10:10:57,502 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:57,502 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:57,533 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:10:57,533 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:10:57,533 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:57,533 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:10:57,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:10:57,533 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:10:57,533 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:10:57,533 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:10:57,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:10:57,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:10:57,533 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:57,533 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:10:57,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:57,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:57,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:57,534 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:57,534 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:10:57,534 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-18 10:10:57,534 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:57,534 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:57,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-18 10:10:57,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:57,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-18 10:10:57,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:57,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-18 10:10:57,535 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-18 10:10:57,535 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-18 10:10:57,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:57,535 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-18 10:10:57,535 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:57,535 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:57,535 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:57,535 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-18 10:10:57,535 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-18 10:10:57,535 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:10:57,535 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:10:57,537 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-18 10:10:57,538 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-18 10:10:57,535 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-18 10:10:57,538 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39709,1689675027617' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-18 10:10:57,538 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-18 10:10:57,538 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:10:57,538 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-18 10:10:57,538 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37417,1689675027545' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-18 10:10:57,538 DEBUG [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 10:10:57,538 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-18 10:10:57,539 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-18 10:10:57,539 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43301,1689675027670' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-18 10:10:57,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-18 10:10:57,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-18 10:10:57,540 DEBUG [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-18 10:10:57,594 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:57,699 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:57,699 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:10:57,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:10:57,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:10:57,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:10:57,740 DEBUG [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 10:10:57,741 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:57,741 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:57,741 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 10:10:57,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:10:57,741 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:57,741 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 10:10:57,741 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:57,741 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:57,741 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 10:10:57,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:10:57,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-18 10:10:57,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-18 10:10:57,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:57,742 DEBUG [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-18 10:10:57,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:10:57,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:10:57,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:57,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:10:57,743 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37417,1689675027545' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-18 10:10:57,743 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3bbcb7ff[Count = 1] remaining members to acquire global barrier 2023-07-18 10:10:57,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:57,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:10:57,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:10:57,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:10:57,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:10:57,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:57,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:10:57,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:10:57,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:57,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:10:57,746 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43301,1689675027670' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-18 10:10:57,746 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3bbcb7ff[Count = 0] remaining members to acquire global barrier 2023-07-18 10:10:57,746 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-18 10:10:57,746 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:57,779 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:57,779 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:57,779 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:57,779 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:57,779 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:57,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:57,779 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:57,779 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-18 10:10:57,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:57,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:57,780 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-18 10:10:57,780 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-18 10:10:57,780 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:10:57,780 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 10:10:57,780 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 10:10:57,780 DEBUG [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689675056083.d1bc758be2ae2e38d5736c4edddf02cf. 2023-07-18 10:10:57,780 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-18 10:10:57,780 DEBUG [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689675056083.d1bc758be2ae2e38d5736c4edddf02cf. started... 2023-07-18 10:10:57,780 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39709,1689675027617' in zk 2023-07-18 10:10:57,780 DEBUG [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d1bc758be2ae2e38d5736c4edddf02cf: 2023-07-18 10:10:57,781 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:57,781 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-18 10:10:57,781 DEBUG [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689675056083.d1bc758be2ae2e38d5736c4edddf02cf.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:57,781 DEBUG [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689675056083.9767db7223bd0efb3bac3fb4df881c98. 2023-07-18 10:10:57,781 DEBUG [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 10:10:57,781 DEBUG [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689675056083.9767db7223bd0efb3bac3fb4df881c98. started... 2023-07-18 10:10:57,781 DEBUG [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-18 10:10:57,781 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 10:10:57,783 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 10:10:57,783 DEBUG [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9767db7223bd0efb3bac3fb4df881c98: 2023-07-18 10:10:57,784 DEBUG [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689675056083.9767db7223bd0efb3bac3fb4df881c98.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:57,784 DEBUG [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 10:10:57,784 DEBUG [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-18 10:10:57,794 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-18 10:10:57,794 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:10:57,794 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-18 10:10:57,796 DEBUG [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689675056083.9767db7223bd0efb3bac3fb4df881c98. completed. 2023-07-18 10:10:57,796 DEBUG [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689675056083.9767db7223bd0efb3bac3fb4df881c98. 2023-07-18 10:10:57,796 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 10:10:57,796 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 10:10:57,796 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:57,796 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-18 10:10:57,796 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43301,1689675027670' in zk 2023-07-18 10:10:57,800 DEBUG [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689675056083.d1bc758be2ae2e38d5736c4edddf02cf. completed. 2023-07-18 10:10:57,800 DEBUG [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689675056083.d1bc758be2ae2e38d5736c4edddf02cf. 2023-07-18 10:10:57,800 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 10:10:57,800 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 10:10:57,800 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:10:57,800 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-18 10:10:57,800 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37417,1689675027545' in zk 2023-07-18 10:10:57,833 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-18 10:10:57,833 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:57,833 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:10:57,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:57,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:10:57,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:10:57,833 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-18 10:10:57,887 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-18 10:10:57,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:10:57,887 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:10:57,887 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:10:57,887 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-18 10:10:57,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:10:57,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:57,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:10:57,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:10:57,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:57,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:10:57,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:57,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:10:57,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:10:57,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:57,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,43301,1689675027670': 2023-07-18 10:10:57,892 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43301,1689675027670' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-18 10:10:57,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:10:57,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:10:57,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:10:57,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:10:57,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:10:57,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:57,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:10:57,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:10:57,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:57,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:10:57,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:57,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:10:57,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:10:57,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:57,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,37417,1689675027545': 2023-07-18 10:10:57,896 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37417,1689675027545' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-18 10:10:57,896 INFO [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-18 10:10:57,896 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-18 10:10:57,896 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-18 10:10:57,896 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:57,896 INFO [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-18 10:10:57,948 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:57,948 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:57,948 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:57,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:57,948 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:57,948 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:57,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:57,949 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:57,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:10:57,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:10:57,948 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:10:57,948 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:57,948 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:10:57,949 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:10:57,949 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:10:57,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:10:57,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:57,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:57,949 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:10:57,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:10:57,950 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:10:57,950 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:10:57,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:10:57,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:57,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:57,950 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:10:57,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:10:57,950 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:57,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:10:57,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:57,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:57,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:57,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:10:57,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:10:57,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:57,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:10:57,954 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:10:57,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:57,954 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:10:57,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:10:57,955 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:57,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:10:57,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:58,002 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:58,002 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:10:58,002 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:58,002 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:10:58,002 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:10:58,002 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:10:58,002 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:10:58,002 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:10:58,002 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:10:58,002 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:58,002 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:10:58,005 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-18 10:10:58,002 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:10:58,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:10:58,004 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:10:58,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:10:58,004 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:10:58,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:10:58,004 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:10:58,005 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:58,005 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:58,005 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:58,005 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:10:58,005 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:10:58,005 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:58,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:10:58,005 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-18 10:10:58,005 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:10:58,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:10:58,005 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:10:58,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:10:58,005 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:10:58,006 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:58,006 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:58,006 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-18 10:10:58,020 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:58,021 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:58,042 DEBUG [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 10:10:58,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-18 10:10:58,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-18 10:10:58,044 DEBUG [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-18 10:10:58,046 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:58,068 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-18 10:10:58,068 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:58,069 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-18 10:10:58,069 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689675057437Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1689675058020 (+583 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1689675058020Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1689675058020Writing data manifest for emptySnaptb0-testExportFileSystemState at 1689675058025 (+5 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1689675058038 (+13 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689675058068 (+30 ms) 2023-07-18 10:10:58,071 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-18 10:10:58,073 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 633 msec 2023-07-18 10:10:58,544 DEBUG [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 10:10:58,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-18 10:10:58,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-18 10:10:58,557 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37417] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1689675056083.d1bc758be2ae2e38d5736c4edddf02cf. with WAL disabled. Data may be lost in the event of a crash. 2023-07-18 10:10:58,561 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43301] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1689675056083.9767db7223bd0efb3bac3fb4df881c98. with WAL disabled. Data may be lost in the event of a crash. 2023-07-18 10:10:58,566 DEBUG [Listener at jenkins-hbase4.apache.org/34477] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-18 10:10:58,566 DEBUG [Listener at jenkins-hbase4.apache.org/34477] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689675056083.d1bc758be2ae2e38d5736c4edddf02cf. 2023-07-18 10:10:58,566 INFO [Listener at jenkins-hbase4.apache.org/34477] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 10:10:58,579 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-18 10:10:58,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689675058579 (current time:1689675058579). 2023-07-18 10:10:58,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-18 10:10:58,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] zookeeper.ReadOnlyZKClient(139): Connect 0x739d9c98 to 127.0.0.1:60990 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 10:10:58,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@646bc769, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 10:10:58,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 10:10:58,592 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54438, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 10:10:58,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x739d9c98 to 127.0.0.1:60990 2023-07-18 10:10:58,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 10:10:58,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] zookeeper.ReadOnlyZKClient(139): Connect 0x01e4fa4c to 127.0.0.1:60990 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 10:10:58,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@24680382, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 10:10:58,607 DEBUG [hconnection-0x7495ae49-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 10:10:58,608 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54452, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 10:10:58,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 10:10:58,617 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53620, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 10:10:58,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x01e4fa4c to 127.0.0.1:60990 2023-07-18 10:10:58,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 10:10:58,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-18 10:10:58,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-18 10:10:58,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-18 10:10:58,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-18 10:10:58,625 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-18 10:10:58,626 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689675658626 2023-07-18 10:10:58,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-18 10:10:58,626 DEBUG [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-18 10:10:58,627 DEBUG [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-18 10:10:58,628 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-18 10:10:58,631 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-18 10:10:58,633 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-18 10:10:58,635 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 9 msec 2023-07-18 10:10:58,637 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-18 10:10:58,640 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689675658640 2023-07-18 10:10:58,682 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-18 10:10:58,683 INFO [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-18 10:10:58,683 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:10:58,684 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-18 10:10:58,684 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-18 10:10:58,685 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 10:10:58,685 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-18 10:10:58,686 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:10:58,686 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:58,686 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:10:58,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:10:58,686 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:10:58,686 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:10:58,687 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:10:58,687 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:10:58,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:10:58,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:10:58,687 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:58,687 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:10:58,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-18 10:10:58,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-18 10:10:58,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-18 10:10:58,691 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 10:10:58,693 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:10:58,693 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-18 10:10:58,693 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 10:10:58,693 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 10:10:58,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-18 10:10:58,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-18 10:10:58,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-18 10:10:58,694 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-18 10:10:58,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-18 10:10:58,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-18 10:10:58,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-18 10:10:58,694 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-18 10:10:58,694 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-18 10:10:58,699 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-18 10:10:58,699 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-18 10:10:58,699 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-18 10:10:58,699 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:10:58,699 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-18 10:10:58,699 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:10:58,704 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-18 10:10:58,706 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-18 10:10:58,706 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-18 10:10:58,706 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:10:58,706 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-18 10:10:58,708 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-18 10:10:58,708 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-18 10:10:58,708 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-18 10:10:58,706 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-18 10:10:58,708 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43301,1689675027670' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-18 10:10:58,708 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39709,1689675027617' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-18 10:10:58,708 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37417,1689675027545' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-18 10:10:58,710 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:58,710 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 10:10:58,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:58,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:10:58,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:10:58,711 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 10:10:58,711 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 10:10:58,711 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:10:58,711 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 10:10:58,711 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 10:10:58,711 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 10:10:58,711 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 10:10:58,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:10:58,711 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 10:10:58,712 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 10:10:58,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:10:58,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-18 10:10:58,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:10:58,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:10:58,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:58,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:10:58,717 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43301,1689675027670' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-18 10:10:58,717 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1b134d24[Count = 1] remaining members to acquire global barrier 2023-07-18 10:10:58,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:10:58,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:10:58,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:10:58,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:10:58,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:10:58,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-18 10:10:58,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:10:58,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:10:58,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:58,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:10:58,720 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37417,1689675027545' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-18 10:10:58,720 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1b134d24[Count = 0] remaining members to acquire global barrier 2023-07-18 10:10:58,720 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-18 10:10:58,720 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 10:10:58,722 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 10:10:58,722 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 10:10:58,722 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 10:10:58,722 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 10:10:58,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 10:10:58,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 10:10:58,723 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-18 10:10:58,723 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-18 10:10:58,723 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39709,1689675027617' in zk 2023-07-18 10:10:58,723 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-18 10:10:58,723 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 10:10:58,723 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 10:10:58,724 DEBUG [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689675056083.9767db7223bd0efb3bac3fb4df881c98. 2023-07-18 10:10:58,724 DEBUG [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689675056083.9767db7223bd0efb3bac3fb4df881c98. started... 2023-07-18 10:10:58,724 INFO [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 9767db7223bd0efb3bac3fb4df881c98 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-18 10:10:58,727 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 10:10:58,727 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 10:10:58,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 10:10:58,727 DEBUG [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 10:10:58,727 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-18 10:10:58,727 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:58,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-18 10:10:58,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-18 10:10:58,729 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:10:58,729 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 10:10:58,729 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 10:10:58,729 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-18 10:10:58,729 DEBUG [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-18 10:10:58,729 DEBUG [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689675056083.d1bc758be2ae2e38d5736c4edddf02cf. 2023-07-18 10:10:58,729 DEBUG [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689675056083.d1bc758be2ae2e38d5736c4edddf02cf. started... 2023-07-18 10:10:58,729 INFO [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] regionserver.HRegion(2745): Flushing d1bc758be2ae2e38d5736c4edddf02cf 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-18 10:10:58,730 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-18 10:10:58,730 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:10:58,730 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-18 10:10:58,786 INFO [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307187f0407dd61b84a9aa4c0b31c41146eea to hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202307187f0407dd61b84a9aa4c0b31c41146eea 2023-07-18 10:10:58,810 INFO [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230718e08ccb1cce4641bb9484dde283a9fa9c to hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230718e08ccb1cce4641bb9484dde283a9fa9c 2023-07-18 10:10:58,835 INFO [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemState/9767db7223bd0efb3bac3fb4df881c98/.tmp/cf/1e9adb712a0f4575a858fa790a9af34c 2023-07-18 10:10:58,845 DEBUG [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemState/9767db7223bd0efb3bac3fb4df881c98/.tmp/cf/1e9adb712a0f4575a858fa790a9af34c as hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemState/9767db7223bd0efb3bac3fb4df881c98/cf/1e9adb712a0f4575a858fa790a9af34c 2023-07-18 10:10:58,860 INFO [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemState/9767db7223bd0efb3bac3fb4df881c98/cf/1e9adb712a0f4575a858fa790a9af34c, entries=46, sequenceid=6, filesize=12.7 K 2023-07-18 10:10:58,861 INFO [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 9767db7223bd0efb3bac3fb4df881c98 in 137ms, sequenceid=6, compaction requested=false 2023-07-18 10:10:58,861 DEBUG [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-18 10:10:58,862 DEBUG [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9767db7223bd0efb3bac3fb4df881c98: 2023-07-18 10:10:58,862 DEBUG [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689675056083.9767db7223bd0efb3bac3fb4df881c98.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-18 10:10:58,862 DEBUG [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 10:10:58,862 DEBUG [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemState/9767db7223bd0efb3bac3fb4df881c98/cf/1e9adb712a0f4575a858fa790a9af34c] hfiles 2023-07-18 10:10:58,862 DEBUG [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemState/9767db7223bd0efb3bac3fb4df881c98/cf/1e9adb712a0f4575a858fa790a9af34c for snapshot=snaptb0-testExportFileSystemState 2023-07-18 10:10:58,882 INFO [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemState/d1bc758be2ae2e38d5736c4edddf02cf/.tmp/cf/52d26e5ec14d4ea4b191bfbd1d257bb4 2023-07-18 10:10:58,893 DEBUG [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemState/d1bc758be2ae2e38d5736c4edddf02cf/.tmp/cf/52d26e5ec14d4ea4b191bfbd1d257bb4 as hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemState/d1bc758be2ae2e38d5736c4edddf02cf/cf/52d26e5ec14d4ea4b191bfbd1d257bb4 2023-07-18 10:10:58,902 INFO [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemState/d1bc758be2ae2e38d5736c4edddf02cf/cf/52d26e5ec14d4ea4b191bfbd1d257bb4, entries=4, sequenceid=6, filesize=5.6 K 2023-07-18 10:10:58,903 INFO [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for d1bc758be2ae2e38d5736c4edddf02cf in 174ms, sequenceid=6, compaction requested=false 2023-07-18 10:10:58,911 DEBUG [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d1bc758be2ae2e38d5736c4edddf02cf: 2023-07-18 10:10:58,911 DEBUG [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689675056083.d1bc758be2ae2e38d5736c4edddf02cf.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-18 10:10:58,911 DEBUG [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 10:10:58,911 DEBUG [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemState/d1bc758be2ae2e38d5736c4edddf02cf/cf/52d26e5ec14d4ea4b191bfbd1d257bb4] hfiles 2023-07-18 10:10:58,911 DEBUG [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemState/d1bc758be2ae2e38d5736c4edddf02cf/cf/52d26e5ec14d4ea4b191bfbd1d257bb4 for snapshot=snaptb0-testExportFileSystemState 2023-07-18 10:10:58,929 DEBUG [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 10:10:58,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-18 10:10:58,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-18 10:10:58,931 DEBUG [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-18 10:10:58,939 DEBUG [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689675056083.9767db7223bd0efb3bac3fb4df881c98. completed. 2023-07-18 10:10:58,939 DEBUG [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689675056083.9767db7223bd0efb3bac3fb4df881c98. 2023-07-18 10:10:58,939 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 10:10:58,939 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 10:10:58,939 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:58,939 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-18 10:10:58,939 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43301,1689675027670' in zk 2023-07-18 10:10:58,945 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-18 10:10:58,945 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:58,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:58,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:10:58,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:10:58,945 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:10:58,946 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-18 10:10:58,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:10:58,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:10:58,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-18 10:10:58,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:10:58,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:10:58,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:58,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:10:58,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-18 10:10:58,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:10:58,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:58,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,43301,1689675027670': 2023-07-18 10:10:58,965 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43301,1689675027670' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-18 10:10:58,977 DEBUG [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689675056083.d1bc758be2ae2e38d5736c4edddf02cf. completed. 2023-07-18 10:10:58,977 DEBUG [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689675056083.d1bc758be2ae2e38d5736c4edddf02cf. 2023-07-18 10:10:58,977 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 10:10:58,977 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 10:10:58,977 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:10:58,977 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-18 10:10:58,977 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37417,1689675027545' in zk 2023-07-18 10:10:58,980 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:10:58,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:10:58,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:10:58,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:10:58,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:10:58,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:10:58,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-18 10:10:58,982 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-18 10:10:58,982 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:10:58,982 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-18 10:10:58,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:10:58,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:10:58,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:58,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:10:58,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-18 10:10:58,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:10:58,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:10:58,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:58,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,37417,1689675027545': 2023-07-18 10:10:58,990 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37417,1689675027545' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-18 10:10:58,990 INFO [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-18 10:10:58,990 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-18 10:10:58,990 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-18 10:10:58,990 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-18 10:10:58,990 INFO [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-18 10:10:58,992 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 10:10:58,992 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 10:10:58,992 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 10:10:58,992 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 10:10:58,992 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 10:10:58,992 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:10:58,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 10:10:58,992 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 10:10:58,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 10:10:58,992 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:10:58,992 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:10:58,992 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 10:10:58,993 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:10:58,993 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:10:58,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:10:58,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 10:10:58,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:10:58,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:10:58,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:10:58,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 10:10:58,994 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:10:58,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 10:10:58,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 10:10:58,994 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:10:58,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:10:58,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 10:10:58,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:10:58,995 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:10:58,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-18 10:10:58,995 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:58,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:10:58,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-18 10:10:58,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:10:58,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:10:58,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:58,997 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:10:58,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:10:58,998 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:10:58,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-18 10:10:58,998 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:58,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:10:58,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:10:58,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:59,002 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:10:59,002 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:10:59,002 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:10:59,002 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:10:59,002 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:59,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:10:59,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:10:59,002 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-18 10:10:59,002 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:10:59,002 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:10:59,002 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-18 10:10:59,002 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:10:59,002 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 10:10:59,002 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:10:59,002 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:10:59,002 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 10:10:59,002 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 10:10:59,006 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:10:59,006 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:10:59,006 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:10:59,006 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-18 10:10:59,006 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-18 10:10:59,006 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:10:59,006 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:10:59,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:10:59,006 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-18 10:10:59,013 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-18 10:10:59,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:10:59,013 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:10:59,013 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:10:59,013 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:10:59,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:10:59,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:10:59,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:10:59,014 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202307187f0407dd61b84a9aa4c0b31c41146eea, hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230718e08ccb1cce4641bb9484dde283a9fa9c] mob files 2023-07-18 10:10:59,014 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202307187f0407dd61b84a9aa4c0b31c41146eea 2023-07-18 10:10:59,014 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230718e08ccb1cce4641bb9484dde283a9fa9c 2023-07-18 10:10:59,032 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-18 10:10:59,032 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-18 10:10:59,063 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-18 10:10:59,093 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-18 10:10:59,094 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-18 10:10:59,094 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-18 10:10:59,094 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689675058628Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1689675059032 (+404 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1689675059032Loading Region manifests for snaptb0-testExportFileSystemState at 1689675059032Writing data manifest for snaptb0-testExportFileSystemState at 1689675059037 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1689675059048 (+11 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689675059093 (+45 ms) 2023-07-18 10:10:59,097 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-18 10:10:59,099 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 467 msec 2023-07-18 10:10:59,231 DEBUG [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 10:10:59,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-18 10:10:59,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-18 10:10:59,233 INFO [Listener at jenkins-hbase4.apache.org/34477] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/export-test/export-1689675059233 2023-07-18 10:10:59,233 INFO [Listener at jenkins-hbase4.apache.org/34477] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:44811, tgtDir=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/export-test/export-1689675059233, rawTgtDir=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/export-test/export-1689675059233, srcFsUri=hdfs://localhost:44811, srcDir=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427 2023-07-18 10:10:59,266 DEBUG [Listener at jenkins-hbase4.apache.org/34477] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44811, inputRoot=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427 2023-07-18 10:10:59,267 DEBUG [Listener at jenkins-hbase4.apache.org/34477] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1107026042_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/export-test/export-1689675059233, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/export-test/export-1689675059233/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-18 10:10:59,267 INFO [Listener at jenkins-hbase4.apache.org/34477] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44811, inputRoot=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427, snapshotDir=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-18 10:10:59,293 INFO [Listener at jenkins-hbase4.apache.org/34477] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/export-test/export-1689675059233/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-18 10:10:59,376 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-18 10:10:59,377 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-18 10:10:59,377 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-18 10:10:59,377 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-18 10:10:59,378 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-18 10:10:59,378 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-18 10:10:59,378 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-18 10:10:59,453 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c329d283-1f43-4a99-3860-7ed90b9830ca/hadoop-7519885606120016695.jar 2023-07-18 10:10:59,454 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-18 10:10:59,454 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-18 10:10:59,454 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-18 10:10:59,455 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-18 10:10:59,455 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-18 10:10:59,455 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-18 10:10:59,456 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-18 10:10:59,456 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-18 10:10:59,456 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-18 10:10:59,457 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-18 10:10:59,457 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-18 10:10:59,458 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-18 10:10:59,458 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-18 10:10:59,458 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-18 10:10:59,458 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-18 10:10:59,459 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-18 10:10:59,459 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 10:10:59,460 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 10:10:59,460 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 10:10:59,460 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 10:10:59,461 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 10:10:59,461 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 10:10:59,461 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 10:10:59,915 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689675035640_0001_000001 (auth:SIMPLE) 2023-07-18 10:11:00,557 WARN [Listener at jenkins-hbase4.apache.org/34477] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-18 10:11:00,560 INFO [Listener at jenkins-hbase4.apache.org/34477] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-18 10:11:00,562 DEBUG [Listener at jenkins-hbase4.apache.org/34477] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-18 10:11:00,635 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 10:11:00,635 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 10:11:00,903 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689675035640_0002_000001 (auth:SIMPLE) 2023-07-18 10:11:01,375 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-18 10:11:05,643 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689675035640_0002_000001 (auth:SIMPLE) 2023-07-18 10:11:07,868 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689675035640_0002_000001 (auth:SIMPLE) 2023-07-18 10:11:10,826 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689675035640_0002_000001 (auth:SIMPLE) 2023-07-18 10:11:11,880 INFO [Listener at jenkins-hbase4.apache.org/34477] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-18 10:11:11,882 INFO [Listener at jenkins-hbase4.apache.org/34477] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-18 10:11:11,890 INFO [Listener at jenkins-hbase4.apache.org/34477] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-18 10:11:11,890 INFO [Listener at jenkins-hbase4.apache.org/34477] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-18 10:11:11,891 INFO [Listener at jenkins-hbase4.apache.org/34477] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-18 10:11:11,891 DEBUG [Listener at jenkins-hbase4.apache.org/34477] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_307542026_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-18 10:11:11,892 DEBUG [Listener at jenkins-hbase4.apache.org/34477] snapshot.TestExportSnapshot(367): hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-18 10:11:11,892 DEBUG [Listener at jenkins-hbase4.apache.org/34477] snapshot.TestExportSnapshot(367): hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-18 10:11:11,892 DEBUG [Listener at jenkins-hbase4.apache.org/34477] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_307542026_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/export-test/export-1689675059233/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/export-test/export-1689675059233/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-18 10:11:11,892 DEBUG [Listener at jenkins-hbase4.apache.org/34477] snapshot.TestExportSnapshot(367): hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/export-test/export-1689675059233/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-18 10:11:11,892 DEBUG [Listener at jenkins-hbase4.apache.org/34477] snapshot.TestExportSnapshot(367): hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/export-test/export-1689675059233/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-18 10:11:11,901 INFO [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-18 10:11:11,901 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-07-18 10:11:11,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-18 10:11:11,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-18 10:11:11,908 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689675071908"}]},"ts":"1689675071908"} 2023-07-18 10:11:11,910 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-18 10:11:11,912 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-18 10:11:11,913 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=d1bc758be2ae2e38d5736c4edddf02cf, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9767db7223bd0efb3bac3fb4df881c98, UNASSIGN}] 2023-07-18 10:11:11,916 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=d1bc758be2ae2e38d5736c4edddf02cf, UNASSIGN 2023-07-18 10:11:11,916 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9767db7223bd0efb3bac3fb4df881c98, UNASSIGN 2023-07-18 10:11:11,917 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=d1bc758be2ae2e38d5736c4edddf02cf, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:11,917 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=9767db7223bd0efb3bac3fb4df881c98, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:11:11,917 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689675056083.9767db7223bd0efb3bac3fb4df881c98.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689675071917"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689675071917"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689675071917"}]},"ts":"1689675071917"} 2023-07-18 10:11:11,917 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689675056083.d1bc758be2ae2e38d5736c4edddf02cf.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689675071917"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689675071917"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689675071917"}]},"ts":"1689675071917"} 2023-07-18 10:11:11,919 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=38, state=RUNNABLE; CloseRegionProcedure 9767db7223bd0efb3bac3fb4df881c98, server=jenkins-hbase4.apache.org,43301,1689675027670}] 2023-07-18 10:11:11,920 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=37, state=RUNNABLE; CloseRegionProcedure d1bc758be2ae2e38d5736c4edddf02cf, server=jenkins-hbase4.apache.org,37417,1689675027545}] 2023-07-18 10:11:12,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-18 10:11:12,072 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 9767db7223bd0efb3bac3fb4df881c98 2023-07-18 10:11:12,072 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9767db7223bd0efb3bac3fb4df881c98, disabling compactions & flushes 2023-07-18 10:11:12,072 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689675056083.9767db7223bd0efb3bac3fb4df881c98. 2023-07-18 10:11:12,072 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689675056083.9767db7223bd0efb3bac3fb4df881c98. 2023-07-18 10:11:12,072 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689675056083.9767db7223bd0efb3bac3fb4df881c98. after waiting 0 ms 2023-07-18 10:11:12,072 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689675056083.9767db7223bd0efb3bac3fb4df881c98. 2023-07-18 10:11:12,076 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close d1bc758be2ae2e38d5736c4edddf02cf 2023-07-18 10:11:12,076 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d1bc758be2ae2e38d5736c4edddf02cf, disabling compactions & flushes 2023-07-18 10:11:12,076 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689675056083.d1bc758be2ae2e38d5736c4edddf02cf. 2023-07-18 10:11:12,076 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689675056083.d1bc758be2ae2e38d5736c4edddf02cf. 2023-07-18 10:11:12,076 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689675056083.d1bc758be2ae2e38d5736c4edddf02cf. after waiting 0 ms 2023-07-18 10:11:12,076 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689675056083.d1bc758be2ae2e38d5736c4edddf02cf. 2023-07-18 10:11:12,089 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemState/9767db7223bd0efb3bac3fb4df881c98/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-18 10:11:12,089 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemState/d1bc758be2ae2e38d5736c4edddf02cf/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-18 10:11:12,090 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 10:11:12,091 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689675056083.9767db7223bd0efb3bac3fb4df881c98. 2023-07-18 10:11:12,091 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9767db7223bd0efb3bac3fb4df881c98: 2023-07-18 10:11:12,091 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 10:11:12,092 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689675056083.d1bc758be2ae2e38d5736c4edddf02cf. 2023-07-18 10:11:12,092 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d1bc758be2ae2e38d5736c4edddf02cf: 2023-07-18 10:11:12,093 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 9767db7223bd0efb3bac3fb4df881c98 2023-07-18 10:11:12,094 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=9767db7223bd0efb3bac3fb4df881c98, regionState=CLOSED 2023-07-18 10:11:12,094 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed d1bc758be2ae2e38d5736c4edddf02cf 2023-07-18 10:11:12,094 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689675056083.9767db7223bd0efb3bac3fb4df881c98.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689675072094"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689675072094"}]},"ts":"1689675072094"} 2023-07-18 10:11:12,095 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=d1bc758be2ae2e38d5736c4edddf02cf, regionState=CLOSED 2023-07-18 10:11:12,095 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689675056083.d1bc758be2ae2e38d5736c4edddf02cf.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689675072095"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689675072095"}]},"ts":"1689675072095"} 2023-07-18 10:11:12,098 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=38 2023-07-18 10:11:12,098 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=38, state=SUCCESS; CloseRegionProcedure 9767db7223bd0efb3bac3fb4df881c98, server=jenkins-hbase4.apache.org,43301,1689675027670 in 177 msec 2023-07-18 10:11:12,099 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=37 2023-07-18 10:11:12,099 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=37, state=SUCCESS; CloseRegionProcedure d1bc758be2ae2e38d5736c4edddf02cf, server=jenkins-hbase4.apache.org,37417,1689675027545 in 177 msec 2023-07-18 10:11:12,102 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9767db7223bd0efb3bac3fb4df881c98, UNASSIGN in 185 msec 2023-07-18 10:11:12,104 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=36 2023-07-18 10:11:12,104 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=d1bc758be2ae2e38d5736c4edddf02cf, UNASSIGN in 186 msec 2023-07-18 10:11:12,105 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689675072105"}]},"ts":"1689675072105"} 2023-07-18 10:11:12,107 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-18 10:11:12,108 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-18 10:11:12,111 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 208 msec 2023-07-18 10:11:12,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-18 10:11:12,210 INFO [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-18 10:11:12,211 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-07-18 10:11:12,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-18 10:11:12,215 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-18 10:11:12,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-18 10:11:12,216 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-18 10:11:12,217 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43301] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-18 10:11:12,221 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportFileSystemState/d1bc758be2ae2e38d5736c4edddf02cf 2023-07-18 10:11:12,221 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportFileSystemState/9767db7223bd0efb3bac3fb4df881c98 2023-07-18 10:11:12,223 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportFileSystemState/d1bc758be2ae2e38d5736c4edddf02cf/cf, FileablePath, hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportFileSystemState/d1bc758be2ae2e38d5736c4edddf02cf/recovered.edits] 2023-07-18 10:11:12,223 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportFileSystemState/9767db7223bd0efb3bac3fb4df881c98/cf, FileablePath, hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportFileSystemState/9767db7223bd0efb3bac3fb4df881c98/recovered.edits] 2023-07-18 10:11:12,223 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-18 10:11:12,223 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-18 10:11:12,223 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-18 10:11:12,223 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-18 10:11:12,224 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-18 10:11:12,224 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-18 10:11:12,224 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-18 10:11:12,224 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-18 10:11:12,225 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-18 10:11:12,225 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:11:12,225 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-18 10:11:12,225 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-18 10:11:12,225 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-18 10:11:12,225 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:11:12,225 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:11:12,225 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:11:12,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-18 10:11:12,228 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportFileSystemState/9767db7223bd0efb3bac3fb4df881c98/cf/1e9adb712a0f4575a858fa790a9af34c to hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/archive/data/default/testtb-testExportFileSystemState/9767db7223bd0efb3bac3fb4df881c98/cf/1e9adb712a0f4575a858fa790a9af34c 2023-07-18 10:11:12,228 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportFileSystemState/d1bc758be2ae2e38d5736c4edddf02cf/cf/52d26e5ec14d4ea4b191bfbd1d257bb4 to hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/archive/data/default/testtb-testExportFileSystemState/d1bc758be2ae2e38d5736c4edddf02cf/cf/52d26e5ec14d4ea4b191bfbd1d257bb4 2023-07-18 10:11:12,231 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportFileSystemState/9767db7223bd0efb3bac3fb4df881c98/recovered.edits/9.seqid to hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/archive/data/default/testtb-testExportFileSystemState/9767db7223bd0efb3bac3fb4df881c98/recovered.edits/9.seqid 2023-07-18 10:11:12,232 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportFileSystemState/d1bc758be2ae2e38d5736c4edddf02cf/recovered.edits/9.seqid to hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/archive/data/default/testtb-testExportFileSystemState/d1bc758be2ae2e38d5736c4edddf02cf/recovered.edits/9.seqid 2023-07-18 10:11:12,232 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportFileSystemState/9767db7223bd0efb3bac3fb4df881c98 2023-07-18 10:11:12,232 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportFileSystemState/d1bc758be2ae2e38d5736c4edddf02cf 2023-07-18 10:11:12,232 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-18 10:11:12,233 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-18 10:11:12,234 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-07-18 10:11:12,237 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202307187f0407dd61b84a9aa4c0b31c41146eea to hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202307187f0407dd61b84a9aa4c0b31c41146eea 2023-07-18 10:11:12,239 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230718e08ccb1cce4641bb9484dde283a9fa9c to hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230718e08ccb1cce4641bb9484dde283a9fa9c 2023-07-18 10:11:12,239 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-18 10:11:12,242 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-18 10:11:12,245 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-18 10:11:12,247 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-18 10:11:12,249 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-18 10:11:12,249 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-18 10:11:12,249 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1689675056083.d1bc758be2ae2e38d5736c4edddf02cf.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689675072249"}]},"ts":"9223372036854775807"} 2023-07-18 10:11:12,249 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1689675056083.9767db7223bd0efb3bac3fb4df881c98.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689675072249"}]},"ts":"9223372036854775807"} 2023-07-18 10:11:12,251 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-18 10:11:12,251 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => d1bc758be2ae2e38d5736c4edddf02cf, NAME => 'testtb-testExportFileSystemState,,1689675056083.d1bc758be2ae2e38d5736c4edddf02cf.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 9767db7223bd0efb3bac3fb4df881c98, NAME => 'testtb-testExportFileSystemState,1,1689675056083.9767db7223bd0efb3bac3fb4df881c98.', STARTKEY => '1', ENDKEY => ''}] 2023-07-18 10:11:12,251 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-18 10:11:12,251 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689675072251"}]},"ts":"9223372036854775807"} 2023-07-18 10:11:12,253 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-18 10:11:12,255 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-18 10:11:12,257 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 44 msec 2023-07-18 10:11:12,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-18 10:11:12,328 INFO [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-18 10:11:12,336 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-18 10:11:12,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-18 10:11:12,340 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-07-18 10:11:12,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-18 10:11:12,372 INFO [Listener at jenkins-hbase4.apache.org/34477] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=766 (was 753) Potentially hanging thread: IPC Client (1988502388) connection to jenkins-hbase4.apache.org/172.31.14.131:42663 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1936827000_17 at /127.0.0.1:45364 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x36ae74de-shared-pool-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_307542026_17 at /127.0.0.1:45862 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1669622330_1 at /127.0.0.1:38472 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x36ae74de-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x36ae74de-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x36ae74de-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_307542026_17 at /127.0.0.1:38484 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-2142 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1988502388) connection to jenkins-hbase4.apache.org/172.31.14.131:34477 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1669622330_1 at /127.0.0.1:45840 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=926 (was 929), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=399 (was 351) - SystemLoadAverage LEAK? -, ProcessCount=183 (was 183), AvailableMemoryMB=2850 (was 3211) 2023-07-18 10:11:12,372 WARN [Listener at jenkins-hbase4.apache.org/34477] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-07-18 10:11:12,399 INFO [Listener at jenkins-hbase4.apache.org/34477] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=766, OpenFileDescriptor=926, MaxFileDescriptor=60000, SystemLoadAverage=399, ProcessCount=183, AvailableMemoryMB=2848 2023-07-18 10:11:12,400 WARN [Listener at jenkins-hbase4.apache.org/34477] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-07-18 10:11:12,402 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-18 10:11:12,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-18 10:11:12,406 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-18 10:11:12,406 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-18 10:11:12,407 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-18 10:11:12,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-18 10:11:12,409 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testConsecutiveExports/33c1fe5cf475cbb2491ecc6f45fe23b0 2023-07-18 10:11:12,409 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testConsecutiveExports/0519db478ba158ce7de46b65ff5faf62 2023-07-18 10:11:12,410 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testConsecutiveExports/33c1fe5cf475cbb2491ecc6f45fe23b0 empty. 2023-07-18 10:11:12,410 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testConsecutiveExports/0519db478ba158ce7de46b65ff5faf62 empty. 2023-07-18 10:11:12,410 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testConsecutiveExports/33c1fe5cf475cbb2491ecc6f45fe23b0 2023-07-18 10:11:12,411 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testConsecutiveExports/0519db478ba158ce7de46b65ff5faf62 2023-07-18 10:11:12,411 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-18 10:11:12,428 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-18 10:11:12,429 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 33c1fe5cf475cbb2491ecc6f45fe23b0, NAME => 'testtb-testConsecutiveExports,,1689675072401.33c1fe5cf475cbb2491ecc6f45fe23b0.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp 2023-07-18 10:11:12,429 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 0519db478ba158ce7de46b65ff5faf62, NAME => 'testtb-testConsecutiveExports,1,1689675072401.0519db478ba158ce7de46b65ff5faf62.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp 2023-07-18 10:11:12,446 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689675072401.33c1fe5cf475cbb2491ecc6f45fe23b0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 10:11:12,446 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 33c1fe5cf475cbb2491ecc6f45fe23b0, disabling compactions & flushes 2023-07-18 10:11:12,446 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689675072401.33c1fe5cf475cbb2491ecc6f45fe23b0. 2023-07-18 10:11:12,447 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689675072401.0519db478ba158ce7de46b65ff5faf62.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 10:11:12,447 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689675072401.33c1fe5cf475cbb2491ecc6f45fe23b0. 2023-07-18 10:11:12,447 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 0519db478ba158ce7de46b65ff5faf62, disabling compactions & flushes 2023-07-18 10:11:12,447 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689675072401.33c1fe5cf475cbb2491ecc6f45fe23b0. after waiting 0 ms 2023-07-18 10:11:12,447 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689675072401.33c1fe5cf475cbb2491ecc6f45fe23b0. 2023-07-18 10:11:12,447 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689675072401.0519db478ba158ce7de46b65ff5faf62. 2023-07-18 10:11:12,447 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689675072401.33c1fe5cf475cbb2491ecc6f45fe23b0. 2023-07-18 10:11:12,447 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689675072401.0519db478ba158ce7de46b65ff5faf62. 2023-07-18 10:11:12,447 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 33c1fe5cf475cbb2491ecc6f45fe23b0: 2023-07-18 10:11:12,447 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689675072401.0519db478ba158ce7de46b65ff5faf62. after waiting 0 ms 2023-07-18 10:11:12,447 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689675072401.0519db478ba158ce7de46b65ff5faf62. 2023-07-18 10:11:12,447 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689675072401.0519db478ba158ce7de46b65ff5faf62. 2023-07-18 10:11:12,447 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 0519db478ba158ce7de46b65ff5faf62: 2023-07-18 10:11:12,449 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-18 10:11:12,450 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689675072401.33c1fe5cf475cbb2491ecc6f45fe23b0.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689675072450"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689675072450"}]},"ts":"1689675072450"} 2023-07-18 10:11:12,450 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689675072401.0519db478ba158ce7de46b65ff5faf62.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689675072450"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689675072450"}]},"ts":"1689675072450"} 2023-07-18 10:11:12,453 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-18 10:11:12,454 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-18 10:11:12,454 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689675072454"}]},"ts":"1689675072454"} 2023-07-18 10:11:12,456 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-18 10:11:12,460 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 10:11:12,461 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 10:11:12,461 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 10:11:12,461 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-18 10:11:12,461 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 10:11:12,461 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=33c1fe5cf475cbb2491ecc6f45fe23b0, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0519db478ba158ce7de46b65ff5faf62, ASSIGN}] 2023-07-18 10:11:12,463 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0519db478ba158ce7de46b65ff5faf62, ASSIGN 2023-07-18 10:11:12,464 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=33c1fe5cf475cbb2491ecc6f45fe23b0, ASSIGN 2023-07-18 10:11:12,464 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=33c1fe5cf475cbb2491ecc6f45fe23b0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37417,1689675027545; forceNewPlan=false, retain=false 2023-07-18 10:11:12,464 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0519db478ba158ce7de46b65ff5faf62, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39709,1689675027617; forceNewPlan=false, retain=false 2023-07-18 10:11:12,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-18 10:11:12,615 INFO [jenkins-hbase4:38235] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-18 10:11:12,617 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=0519db478ba158ce7de46b65ff5faf62, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:11:12,617 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=33c1fe5cf475cbb2491ecc6f45fe23b0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:12,618 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689675072401.0519db478ba158ce7de46b65ff5faf62.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689675072617"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689675072617"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689675072617"}]},"ts":"1689675072617"} 2023-07-18 10:11:12,618 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689675072401.33c1fe5cf475cbb2491ecc6f45fe23b0.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689675072617"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689675072617"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689675072617"}]},"ts":"1689675072617"} 2023-07-18 10:11:12,620 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE; OpenRegionProcedure 0519db478ba158ce7de46b65ff5faf62, server=jenkins-hbase4.apache.org,39709,1689675027617}] 2023-07-18 10:11:12,621 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; OpenRegionProcedure 33c1fe5cf475cbb2491ecc6f45fe23b0, server=jenkins-hbase4.apache.org,37417,1689675027545}] 2023-07-18 10:11:12,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-18 10:11:12,778 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1689675072401.33c1fe5cf475cbb2491ecc6f45fe23b0. 2023-07-18 10:11:12,778 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1689675072401.0519db478ba158ce7de46b65ff5faf62. 2023-07-18 10:11:12,778 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 33c1fe5cf475cbb2491ecc6f45fe23b0, NAME => 'testtb-testConsecutiveExports,,1689675072401.33c1fe5cf475cbb2491ecc6f45fe23b0.', STARTKEY => '', ENDKEY => '1'} 2023-07-18 10:11:12,778 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0519db478ba158ce7de46b65ff5faf62, NAME => 'testtb-testConsecutiveExports,1,1689675072401.0519db478ba158ce7de46b65ff5faf62.', STARTKEY => '1', ENDKEY => ''} 2023-07-18 10:11:12,778 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1689675072401.33c1fe5cf475cbb2491ecc6f45fe23b0. service=AccessControlService 2023-07-18 10:11:12,778 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1689675072401.0519db478ba158ce7de46b65ff5faf62. service=AccessControlService 2023-07-18 10:11:12,779 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 10:11:12,779 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 10:11:12,779 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 33c1fe5cf475cbb2491ecc6f45fe23b0 2023-07-18 10:11:12,779 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 0519db478ba158ce7de46b65ff5faf62 2023-07-18 10:11:12,779 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689675072401.33c1fe5cf475cbb2491ecc6f45fe23b0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 10:11:12,779 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689675072401.0519db478ba158ce7de46b65ff5faf62.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 10:11:12,779 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 33c1fe5cf475cbb2491ecc6f45fe23b0 2023-07-18 10:11:12,779 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0519db478ba158ce7de46b65ff5faf62 2023-07-18 10:11:12,779 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 33c1fe5cf475cbb2491ecc6f45fe23b0 2023-07-18 10:11:12,779 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0519db478ba158ce7de46b65ff5faf62 2023-07-18 10:11:12,780 INFO [StoreOpener-33c1fe5cf475cbb2491ecc6f45fe23b0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 33c1fe5cf475cbb2491ecc6f45fe23b0 2023-07-18 10:11:12,780 INFO [StoreOpener-0519db478ba158ce7de46b65ff5faf62-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0519db478ba158ce7de46b65ff5faf62 2023-07-18 10:11:12,782 DEBUG [StoreOpener-33c1fe5cf475cbb2491ecc6f45fe23b0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testConsecutiveExports/33c1fe5cf475cbb2491ecc6f45fe23b0/cf 2023-07-18 10:11:12,782 DEBUG [StoreOpener-0519db478ba158ce7de46b65ff5faf62-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testConsecutiveExports/0519db478ba158ce7de46b65ff5faf62/cf 2023-07-18 10:11:12,782 DEBUG [StoreOpener-33c1fe5cf475cbb2491ecc6f45fe23b0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testConsecutiveExports/33c1fe5cf475cbb2491ecc6f45fe23b0/cf 2023-07-18 10:11:12,782 DEBUG [StoreOpener-0519db478ba158ce7de46b65ff5faf62-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testConsecutiveExports/0519db478ba158ce7de46b65ff5faf62/cf 2023-07-18 10:11:12,782 INFO [StoreOpener-33c1fe5cf475cbb2491ecc6f45fe23b0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 33c1fe5cf475cbb2491ecc6f45fe23b0 columnFamilyName cf 2023-07-18 10:11:12,782 INFO [StoreOpener-0519db478ba158ce7de46b65ff5faf62-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0519db478ba158ce7de46b65ff5faf62 columnFamilyName cf 2023-07-18 10:11:12,783 INFO [StoreOpener-33c1fe5cf475cbb2491ecc6f45fe23b0-1] regionserver.HStore(310): Store=33c1fe5cf475cbb2491ecc6f45fe23b0/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 10:11:12,784 INFO [StoreOpener-0519db478ba158ce7de46b65ff5faf62-1] regionserver.HStore(310): Store=0519db478ba158ce7de46b65ff5faf62/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 10:11:12,784 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testConsecutiveExports/33c1fe5cf475cbb2491ecc6f45fe23b0 2023-07-18 10:11:12,785 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testConsecutiveExports/0519db478ba158ce7de46b65ff5faf62 2023-07-18 10:11:12,785 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testConsecutiveExports/33c1fe5cf475cbb2491ecc6f45fe23b0 2023-07-18 10:11:12,785 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testConsecutiveExports/0519db478ba158ce7de46b65ff5faf62 2023-07-18 10:11:12,788 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 33c1fe5cf475cbb2491ecc6f45fe23b0 2023-07-18 10:11:12,788 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0519db478ba158ce7de46b65ff5faf62 2023-07-18 10:11:12,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testConsecutiveExports/33c1fe5cf475cbb2491ecc6f45fe23b0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 10:11:12,790 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testConsecutiveExports/0519db478ba158ce7de46b65ff5faf62/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 10:11:12,790 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 33c1fe5cf475cbb2491ecc6f45fe23b0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68470086, jitterRate=0.020283788442611694}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 10:11:12,790 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 33c1fe5cf475cbb2491ecc6f45fe23b0: 2023-07-18 10:11:12,790 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0519db478ba158ce7de46b65ff5faf62; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75158796, jitterRate=0.11995333433151245}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 10:11:12,790 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0519db478ba158ce7de46b65ff5faf62: 2023-07-18 10:11:12,791 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1689675072401.33c1fe5cf475cbb2491ecc6f45fe23b0., pid=46, masterSystemTime=1689675072773 2023-07-18 10:11:12,791 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1689675072401.0519db478ba158ce7de46b65ff5faf62., pid=45, masterSystemTime=1689675072772 2023-07-18 10:11:12,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1689675072401.33c1fe5cf475cbb2491ecc6f45fe23b0. 2023-07-18 10:11:12,793 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1689675072401.33c1fe5cf475cbb2491ecc6f45fe23b0. 2023-07-18 10:11:12,793 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=33c1fe5cf475cbb2491ecc6f45fe23b0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:12,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1689675072401.0519db478ba158ce7de46b65ff5faf62. 2023-07-18 10:11:12,793 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1689675072401.0519db478ba158ce7de46b65ff5faf62. 2023-07-18 10:11:12,794 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1689675072401.33c1fe5cf475cbb2491ecc6f45fe23b0.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689675072793"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689675072793"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689675072793"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689675072793"}]},"ts":"1689675072793"} 2023-07-18 10:11:12,794 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=0519db478ba158ce7de46b65ff5faf62, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:11:12,794 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1689675072401.0519db478ba158ce7de46b65ff5faf62.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689675072794"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689675072794"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689675072794"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689675072794"}]},"ts":"1689675072794"} 2023-07-18 10:11:12,798 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=43 2023-07-18 10:11:12,798 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=43, state=SUCCESS; OpenRegionProcedure 33c1fe5cf475cbb2491ecc6f45fe23b0, server=jenkins-hbase4.apache.org,37417,1689675027545 in 176 msec 2023-07-18 10:11:12,800 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=33c1fe5cf475cbb2491ecc6f45fe23b0, ASSIGN in 337 msec 2023-07-18 10:11:12,805 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=44 2023-07-18 10:11:12,805 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=44, state=SUCCESS; OpenRegionProcedure 0519db478ba158ce7de46b65ff5faf62, server=jenkins-hbase4.apache.org,39709,1689675027617 in 183 msec 2023-07-18 10:11:12,807 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=42 2023-07-18 10:11:12,808 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0519db478ba158ce7de46b65ff5faf62, ASSIGN in 344 msec 2023-07-18 10:11:12,808 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-18 10:11:12,809 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689675072808"}]},"ts":"1689675072808"} 2023-07-18 10:11:12,810 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-18 10:11:12,813 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-18 10:11:12,813 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-18 10:11:12,816 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43301] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-18 10:11:12,817 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:11:12,817 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:11:12,817 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:11:12,817 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:11:12,819 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-18 10:11:12,819 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-18 10:11:12,819 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-18 10:11:12,820 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-18 10:11:12,821 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 417 msec 2023-07-18 10:11:13,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-18 10:11:13,011 INFO [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-18 10:11:13,014 DEBUG [Listener at jenkins-hbase4.apache.org/34477] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-18 10:11:13,014 DEBUG [Listener at jenkins-hbase4.apache.org/34477] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689675072401.33c1fe5cf475cbb2491ecc6f45fe23b0. 2023-07-18 10:11:13,016 INFO [Listener at jenkins-hbase4.apache.org/34477] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 10:11:13,028 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-18 10:11:13,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689675073028 (current time:1689675073028). 2023-07-18 10:11:13,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-18 10:11:13,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] zookeeper.ReadOnlyZKClient(139): Connect 0x6a418b9f to 127.0.0.1:60990 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 10:11:13,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1ec4bd1e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 10:11:13,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 10:11:13,040 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47636, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 10:11:13,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6a418b9f to 127.0.0.1:60990 2023-07-18 10:11:13,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 10:11:13,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] zookeeper.ReadOnlyZKClient(139): Connect 0x2913d7c1 to 127.0.0.1:60990 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 10:11:13,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4fe8ac0f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 10:11:13,048 DEBUG [hconnection-0x74ffc4a1-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 10:11:13,050 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47640, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 10:11:13,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 10:11:13,056 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41814, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 10:11:13,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2913d7c1 to 127.0.0.1:60990 2023-07-18 10:11:13,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 10:11:13,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-18 10:11:13,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-18 10:11:13,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-18 10:11:13,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-18 10:11:13,061 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-18 10:11:13,062 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689675673062 2023-07-18 10:11:13,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-18 10:11:13,062 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-18 10:11:13,064 DEBUG [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-18 10:11:13,064 DEBUG [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-18 10:11:13,067 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-18 10:11:13,067 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-18 10:11:13,068 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 8 msec 2023-07-18 10:11:13,069 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-18 10:11:13,070 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689675673070 2023-07-18 10:11:13,086 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,086 INFO [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-18 10:11:13,086 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:11:13,087 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-18 10:11:13,087 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-18 10:11:13,087 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,087 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,094 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:13,094 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:11:13,094 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:11:13,094 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:11:13,094 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:11:13,094 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:11:13,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:11:13,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:11:13,094 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:11:13,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:11:13,095 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:13,095 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:11:13,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,095 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:11:13,095 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-18 10:11:13,095 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,095 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,096 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-18 10:11:13,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-18 10:11:13,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,096 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-18 10:11:13,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-18 10:11:13,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,096 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-18 10:11:13,096 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-18 10:11:13,098 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,099 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-18 10:11:13,099 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:11:13,103 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-18 10:11:13,103 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-18 10:11:13,103 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,103 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39709,1689675027617' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-18 10:11:13,103 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-18 10:11:13,103 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:11:13,103 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,104 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-18 10:11:13,104 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-18 10:11:13,104 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43301,1689675027670' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-18 10:11:13,104 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-18 10:11:13,104 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:11:13,107 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-18 10:11:13,107 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-18 10:11:13,108 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37417,1689675027545' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-18 10:11:13,109 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,109 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:11:13,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:11:13,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:11:13,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:11:13,110 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,111 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:13,111 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,111 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:11:13,111 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,111 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 10:11:13,111 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 10:11:13,111 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,111 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 10:11:13,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:11:13,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:11:13,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:13,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:11:13,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:11:13,113 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39709,1689675027617' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-18 10:11:13,113 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@20d581ac[Count = 1] remaining members to acquire global barrier 2023-07-18 10:11:13,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:13,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:11:13,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:11:13,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:11:13,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:11:13,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:11:13,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:13,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:11:13,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:11:13,115 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37417,1689675027545' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-18 10:11:13,115 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@20d581ac[Count = 0] remaining members to acquire global barrier 2023-07-18 10:11:13,115 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-18 10:11:13,115 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,118 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,118 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,118 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,118 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,118 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,118 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-18 10:11:13,118 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,118 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-18 10:11:13,118 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 10:11:13,118 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-18 10:11:13,118 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-18 10:11:13,118 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,43301,1689675027670' in zk 2023-07-18 10:11:13,118 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 10:11:13,118 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 10:11:13,118 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:11:13,118 DEBUG [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689675072401.33c1fe5cf475cbb2491ecc6f45fe23b0. 2023-07-18 10:11:13,118 DEBUG [rs(jenkins-hbase4.apache.org,39709,1689675027617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689675072401.0519db478ba158ce7de46b65ff5faf62. 2023-07-18 10:11:13,118 DEBUG [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689675072401.33c1fe5cf475cbb2491ecc6f45fe23b0. started... 2023-07-18 10:11:13,118 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 10:11:13,118 DEBUG [rs(jenkins-hbase4.apache.org,39709,1689675027617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689675072401.0519db478ba158ce7de46b65ff5faf62. started... 2023-07-18 10:11:13,119 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:13,119 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-18 10:11:13,120 DEBUG [rs(jenkins-hbase4.apache.org,39709,1689675027617)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0519db478ba158ce7de46b65ff5faf62: 2023-07-18 10:11:13,120 DEBUG [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 33c1fe5cf475cbb2491ecc6f45fe23b0: 2023-07-18 10:11:13,120 DEBUG [rs(jenkins-hbase4.apache.org,39709,1689675027617)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689675072401.0519db478ba158ce7de46b65ff5faf62.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,120 DEBUG [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689675072401.33c1fe5cf475cbb2491ecc6f45fe23b0.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,120 DEBUG [rs(jenkins-hbase4.apache.org,39709,1689675027617)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 10:11:13,121 DEBUG [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 10:11:13,121 DEBUG [rs(jenkins-hbase4.apache.org,39709,1689675027617)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-18 10:11:13,121 DEBUG [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-18 10:11:13,127 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-18 10:11:13,127 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:11:13,127 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-18 10:11:13,138 DEBUG [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689675072401.33c1fe5cf475cbb2491ecc6f45fe23b0. completed. 2023-07-18 10:11:13,138 DEBUG [rs(jenkins-hbase4.apache.org,39709,1689675027617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689675072401.0519db478ba158ce7de46b65ff5faf62. completed. 2023-07-18 10:11:13,139 DEBUG [rs(jenkins-hbase4.apache.org,39709,1689675027617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689675072401.0519db478ba158ce7de46b65ff5faf62. 2023-07-18 10:11:13,139 DEBUG [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689675072401.33c1fe5cf475cbb2491ecc6f45fe23b0. 2023-07-18 10:11:13,139 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 10:11:13,139 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 10:11:13,139 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:11:13,139 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 10:11:13,139 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 10:11:13,139 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-18 10:11:13,139 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:13,139 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,39709,1689675027617' in zk 2023-07-18 10:11:13,139 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-18 10:11:13,139 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,37417,1689675027545' in zk 2023-07-18 10:11:13,141 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-18 10:11:13,141 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-18 10:11:13,141 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:11:13,141 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:11:13,141 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-18 10:11:13,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:11:13,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:11:13,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:11:13,141 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:11:13,142 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:13,142 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-18 10:11:13,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:11:13,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:11:13,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:11:13,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:13,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:11:13,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:11:13,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:11:13,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:13,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:11:13,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,39709,1689675027617': 2023-07-18 10:11:13,148 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39709,1689675027617' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-18 10:11:13,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:13,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:11:13,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:11:13,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:11:13,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:11:13,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:11:13,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:13,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:11:13,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:11:13,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:11:13,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:13,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:11:13,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,37417,1689675027545': 2023-07-18 10:11:13,151 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37417,1689675027545' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-18 10:11:13,151 INFO [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-18 10:11:13,151 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-18 10:11:13,151 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-18 10:11:13,151 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,151 INFO [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-18 10:11:13,154 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,154 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,154 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:11:13,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:11:13,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,154 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,154 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:11:13,155 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,154 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,155 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:11:13,155 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:11:13,155 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:11:13,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:11:13,155 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,155 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:11:13,155 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:11:13,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:11:13,156 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:13,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:11:13,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,156 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:11:13,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:11:13,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,156 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:11:13,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:11:13,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:11:13,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:13,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:11:13,159 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:11:13,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:11:13,159 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:13,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,160 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:11:13,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:11:13,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:13,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:11:13,163 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:11:13,163 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,163 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:11:13,163 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:13,163 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:11:13,163 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,163 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:11:13,164 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:11:13,164 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,163 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:11:13,163 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:11:13,163 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:11:13,163 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:11:13,165 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:11:13,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:11:13,165 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:11:13,165 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:11:13,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:11:13,165 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:11:13,165 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,165 DEBUG [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 10:11:13,164 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-18 10:11:13,166 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:11:13,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:11:13,166 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:11:13,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:11:13,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:11:13,166 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,166 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:13,166 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-18 10:11:13,166 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:11:13,166 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,166 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-18 10:11:13,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-18 10:11:13,167 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:11:13,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:11:13,167 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-18 10:11:13,167 DEBUG [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-18 10:11:13,175 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,176 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,198 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,222 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-18 10:11:13,222 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,223 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:13,223 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689675073063Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1689675073175 (+112 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1689675073175Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1689675073175Writing data manifest for emptySnaptb0-testConsecutiveExports at 1689675073178 (+3 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1689675073192 (+14 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689675073222 (+30 ms) 2023-07-18 10:11:13,225 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-18 10:11:13,227 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 162 msec 2023-07-18 10:11:13,367 DEBUG [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 10:11:13,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-18 10:11:13,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-18 10:11:13,371 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37417] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1689675072401.33c1fe5cf475cbb2491ecc6f45fe23b0. with WAL disabled. Data may be lost in the event of a crash. 2023-07-18 10:11:13,373 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39709] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1689675072401.0519db478ba158ce7de46b65ff5faf62. with WAL disabled. Data may be lost in the event of a crash. 2023-07-18 10:11:13,375 DEBUG [Listener at jenkins-hbase4.apache.org/34477] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-18 10:11:13,376 DEBUG [Listener at jenkins-hbase4.apache.org/34477] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689675072401.33c1fe5cf475cbb2491ecc6f45fe23b0. 2023-07-18 10:11:13,376 INFO [Listener at jenkins-hbase4.apache.org/34477] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 10:11:13,385 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-18 10:11:13,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689675073385 (current time:1689675073385). 2023-07-18 10:11:13,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-18 10:11:13,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] zookeeper.ReadOnlyZKClient(139): Connect 0x1dbdf714 to 127.0.0.1:60990 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 10:11:13,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@21612d7a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 10:11:13,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 10:11:13,400 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47642, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 10:11:13,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1dbdf714 to 127.0.0.1:60990 2023-07-18 10:11:13,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 10:11:13,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] zookeeper.ReadOnlyZKClient(139): Connect 0x2bc75aa1 to 127.0.0.1:60990 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 10:11:13,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@59300d9a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 10:11:13,409 DEBUG [hconnection-0x7112e13b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 10:11:13,412 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47644, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 10:11:13,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 10:11:13,417 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41820, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 10:11:13,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2bc75aa1 to 127.0.0.1:60990 2023-07-18 10:11:13,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 10:11:13,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-18 10:11:13,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-18 10:11:13,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-18 10:11:13,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-18 10:11:13,423 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-18 10:11:13,424 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689675673424 2023-07-18 10:11:13,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-18 10:11:13,424 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-18 10:11:13,426 DEBUG [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-18 10:11:13,426 DEBUG [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-18 10:11:13,427 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-18 10:11:13,427 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-18 10:11:13,428 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 6 msec 2023-07-18 10:11:13,429 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-18 10:11:13,430 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689675673430 2023-07-18 10:11:13,442 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-18 10:11:13,442 INFO [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-18 10:11:13,442 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:11:13,444 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-18 10:11:13,444 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-18 10:11:13,444 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 10:11:13,444 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-18 10:11:13,445 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:13,445 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:11:13,445 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:11:13,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:11:13,446 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:11:13,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:11:13,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:11:13,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:11:13,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:11:13,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:11:13,446 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:13,446 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:11:13,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-18 10:11:13,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-18 10:11:13,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-18 10:11:13,446 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 10:11:13,446 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:11:13,447 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-18 10:11:13,447 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 10:11:13,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-18 10:11:13,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-18 10:11:13,447 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 10:11:13,447 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-18 10:11:13,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-18 10:11:13,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-18 10:11:13,447 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-18 10:11:13,447 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-18 10:11:13,447 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-18 10:11:13,447 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:11:13,448 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-18 10:11:13,449 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-18 10:11:13,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-18 10:11:13,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-18 10:11:13,449 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-18 10:11:13,449 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43301,1689675027670' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-18 10:11:13,449 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-18 10:11:13,449 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-18 10:11:13,449 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:11:13,449 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-18 10:11:13,450 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-18 10:11:13,450 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-18 10:11:13,450 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:11:13,450 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-18 10:11:13,452 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39709,1689675027617' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-18 10:11:13,451 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-18 10:11:13,452 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-18 10:11:13,452 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37417,1689675027545' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-18 10:11:13,454 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 10:11:13,455 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 10:11:13,455 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:11:13,455 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 10:11:13,455 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 10:11:13,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:11:13,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:11:13,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:11:13,458 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:13,458 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 10:11:13,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:11:13,458 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 10:11:13,458 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 10:11:13,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:11:13,458 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 10:11:13,458 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 10:11:13,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-18 10:11:13,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:11:13,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:13,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:11:13,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:11:13,460 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39709,1689675027617' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-18 10:11:13,460 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2514e381[Count = 1] remaining members to acquire global barrier 2023-07-18 10:11:13,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:13,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:11:13,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:11:13,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:11:13,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:11:13,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-18 10:11:13,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:11:13,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:13,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:11:13,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:11:13,463 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37417,1689675027545' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-18 10:11:13,463 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2514e381[Count = 0] remaining members to acquire global barrier 2023-07-18 10:11:13,463 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-18 10:11:13,463 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 10:11:13,465 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 10:11:13,465 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 10:11:13,465 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 10:11:13,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 10:11:13,465 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 10:11:13,465 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-18 10:11:13,465 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 10:11:13,465 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:11:13,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 10:11:13,466 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 10:11:13,466 DEBUG [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689675072401.33c1fe5cf475cbb2491ecc6f45fe23b0. 2023-07-18 10:11:13,466 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-18 10:11:13,466 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 10:11:13,466 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-18 10:11:13,466 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:13,466 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,43301,1689675027670' in zk 2023-07-18 10:11:13,466 DEBUG [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689675072401.33c1fe5cf475cbb2491ecc6f45fe23b0. started... 2023-07-18 10:11:13,466 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 10:11:13,466 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-18 10:11:13,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 10:11:13,466 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-18 10:11:13,466 INFO [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 33c1fe5cf475cbb2491ecc6f45fe23b0 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-18 10:11:13,467 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 10:11:13,467 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 10:11:13,467 DEBUG [rs(jenkins-hbase4.apache.org,39709,1689675027617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689675072401.0519db478ba158ce7de46b65ff5faf62. 2023-07-18 10:11:13,467 DEBUG [rs(jenkins-hbase4.apache.org,39709,1689675027617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689675072401.0519db478ba158ce7de46b65ff5faf62. started... 2023-07-18 10:11:13,467 INFO [rs(jenkins-hbase4.apache.org,39709,1689675027617)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 0519db478ba158ce7de46b65ff5faf62 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-18 10:11:13,469 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-18 10:11:13,469 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:11:13,469 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-18 10:11:13,512 INFO [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023071882831507974c462ab088bbdae2dd1354 to hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023071882831507974c462ab088bbdae2dd1354 2023-07-18 10:11:13,516 INFO [rs(jenkins-hbase4.apache.org,39709,1689675027617)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230718e0c8450da28842b6a993f161082525a6 to hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230718e0c8450da28842b6a993f161082525a6 2023-07-18 10:11:13,525 INFO [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testConsecutiveExports/33c1fe5cf475cbb2491ecc6f45fe23b0/.tmp/cf/42fa449e3dc6463494e90865b0dbe7fc 2023-07-18 10:11:13,525 INFO [rs(jenkins-hbase4.apache.org,39709,1689675027617)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testConsecutiveExports/0519db478ba158ce7de46b65ff5faf62/.tmp/cf/06ecc9adb7494a36ba47a52192f9162c 2023-07-18 10:11:13,526 DEBUG [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 10:11:13,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-18 10:11:13,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-18 10:11:13,528 DEBUG [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-18 10:11:13,532 DEBUG [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testConsecutiveExports/33c1fe5cf475cbb2491ecc6f45fe23b0/.tmp/cf/42fa449e3dc6463494e90865b0dbe7fc as hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testConsecutiveExports/33c1fe5cf475cbb2491ecc6f45fe23b0/cf/42fa449e3dc6463494e90865b0dbe7fc 2023-07-18 10:11:13,532 DEBUG [rs(jenkins-hbase4.apache.org,39709,1689675027617)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testConsecutiveExports/0519db478ba158ce7de46b65ff5faf62/.tmp/cf/06ecc9adb7494a36ba47a52192f9162c as hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testConsecutiveExports/0519db478ba158ce7de46b65ff5faf62/cf/06ecc9adb7494a36ba47a52192f9162c 2023-07-18 10:11:13,537 INFO [rs(jenkins-hbase4.apache.org,39709,1689675027617)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testConsecutiveExports/0519db478ba158ce7de46b65ff5faf62/cf/06ecc9adb7494a36ba47a52192f9162c, entries=48, sequenceid=6, filesize=12.9 K 2023-07-18 10:11:13,538 INFO [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testConsecutiveExports/33c1fe5cf475cbb2491ecc6f45fe23b0/cf/42fa449e3dc6463494e90865b0dbe7fc, entries=2, sequenceid=6, filesize=5.2 K 2023-07-18 10:11:13,539 INFO [rs(jenkins-hbase4.apache.org,39709,1689675027617)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 0519db478ba158ce7de46b65ff5faf62 in 71ms, sequenceid=6, compaction requested=false 2023-07-18 10:11:13,539 DEBUG [rs(jenkins-hbase4.apache.org,39709,1689675027617)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-18 10:11:13,539 INFO [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 33c1fe5cf475cbb2491ecc6f45fe23b0 in 73ms, sequenceid=6, compaction requested=false 2023-07-18 10:11:13,539 DEBUG [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-18 10:11:13,541 DEBUG [rs(jenkins-hbase4.apache.org,39709,1689675027617)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0519db478ba158ce7de46b65ff5faf62: 2023-07-18 10:11:13,541 DEBUG [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 33c1fe5cf475cbb2491ecc6f45fe23b0: 2023-07-18 10:11:13,541 DEBUG [rs(jenkins-hbase4.apache.org,39709,1689675027617)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689675072401.0519db478ba158ce7de46b65ff5faf62.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-18 10:11:13,541 DEBUG [rs(jenkins-hbase4.apache.org,39709,1689675027617)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 10:11:13,541 DEBUG [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689675072401.33c1fe5cf475cbb2491ecc6f45fe23b0.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-18 10:11:13,541 DEBUG [rs(jenkins-hbase4.apache.org,39709,1689675027617)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testConsecutiveExports/0519db478ba158ce7de46b65ff5faf62/cf/06ecc9adb7494a36ba47a52192f9162c] hfiles 2023-07-18 10:11:13,541 DEBUG [rs(jenkins-hbase4.apache.org,39709,1689675027617)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testConsecutiveExports/0519db478ba158ce7de46b65ff5faf62/cf/06ecc9adb7494a36ba47a52192f9162c for snapshot=snaptb0-testConsecutiveExports 2023-07-18 10:11:13,541 DEBUG [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 10:11:13,541 DEBUG [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testConsecutiveExports/33c1fe5cf475cbb2491ecc6f45fe23b0/cf/42fa449e3dc6463494e90865b0dbe7fc] hfiles 2023-07-18 10:11:13,541 DEBUG [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testConsecutiveExports/33c1fe5cf475cbb2491ecc6f45fe23b0/cf/42fa449e3dc6463494e90865b0dbe7fc for snapshot=snaptb0-testConsecutiveExports 2023-07-18 10:11:13,549 DEBUG [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689675072401.33c1fe5cf475cbb2491ecc6f45fe23b0. completed. 2023-07-18 10:11:13,549 DEBUG [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689675072401.33c1fe5cf475cbb2491ecc6f45fe23b0. 2023-07-18 10:11:13,550 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 10:11:13,550 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 10:11:13,550 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:13,550 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-18 10:11:13,550 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,37417,1689675027545' in zk 2023-07-18 10:11:13,551 DEBUG [rs(jenkins-hbase4.apache.org,39709,1689675027617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689675072401.0519db478ba158ce7de46b65ff5faf62. completed. 2023-07-18 10:11:13,551 DEBUG [rs(jenkins-hbase4.apache.org,39709,1689675027617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689675072401.0519db478ba158ce7de46b65ff5faf62. 2023-07-18 10:11:13,551 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 10:11:13,551 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 10:11:13,551 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:11:13,551 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-18 10:11:13,551 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,39709,1689675027617' in zk 2023-07-18 10:11:13,551 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:13,551 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-18 10:11:13,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:13,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:11:13,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:11:13,552 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:11:13,552 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-18 10:11:13,555 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:11:13,555 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-18 10:11:13,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:11:13,555 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:11:13,555 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-18 10:11:13,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:11:13,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-18 10:11:13,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:11:13,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:13,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:11:13,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:11:13,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-18 10:11:13,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:13,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:11:13,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:11:13,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,37417,1689675027545': 2023-07-18 10:11:13,559 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37417,1689675027545' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-18 10:11:13,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:11:13,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:11:13,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:11:13,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:11:13,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:11:13,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-18 10:11:13,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:11:13,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:13,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:11:13,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:11:13,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-18 10:11:13,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:13,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:11:13,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:11:13,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,39709,1689675027617': 2023-07-18 10:11:13,562 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39709,1689675027617' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-18 10:11:13,562 INFO [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-18 10:11:13,563 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-18 10:11:13,563 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-18 10:11:13,563 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-18 10:11:13,563 INFO [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-18 10:11:13,564 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 10:11:13,564 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 10:11:13,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 10:11:13,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:11:13,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:11:13,564 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 10:11:13,564 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 10:11:13,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 10:11:13,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 10:11:13,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 10:11:13,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:11:13,565 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:11:13,565 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:11:13,565 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:11:13,564 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 10:11:13,564 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:11:13,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 10:11:13,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 10:11:13,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-18 10:11:13,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:11:13,565 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:13,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:11:13,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:11:13,566 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:11:13,566 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:11:13,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:11:13,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 10:11:13,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:11:13,566 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:11:13,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 10:11:13,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-18 10:11:13,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 10:11:13,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:11:13,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:13,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:11:13,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:11:13,568 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:13,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-18 10:11:13,568 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:11:13,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:13,569 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:11:13,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:11:13,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:11:13,575 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:11:13,575 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:11:13,575 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:11:13,575 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-18 10:11:13,575 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:11:13,575 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-18 10:11:13,575 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:11:13,575 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-18 10:11:13,575 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:11:13,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:11:13,575 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-18 10:11:13,575 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:11:13,575 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:11:13,576 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-18 10:11:13,575 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:11:13,576 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:11:13,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:11:13,575 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:11:13,575 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:11:13,575 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:13,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:11:13,577 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:11:13,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:11:13,577 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-18 10:11:13,578 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:11:13,578 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 10:11:13,578 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:11:13,578 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:13,578 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 10:11:13,578 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 10:11:13,578 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:11:13,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:11:13,578 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:11:13,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:11:13,578 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230718e0c8450da28842b6a993f161082525a6, hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023071882831507974c462ab088bbdae2dd1354] mob files 2023-07-18 10:11:13,578 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230718e0c8450da28842b6a993f161082525a6 2023-07-18 10:11:13,578 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023071882831507974c462ab088bbdae2dd1354 2023-07-18 10:11:13,589 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-18 10:11:13,589 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-18 10:11:13,611 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-18 10:11:13,639 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-18 10:11:13,639 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-18 10:11:13,640 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-18 10:11:13,640 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689675073424Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1689675073589 (+165 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1689675073589Loading Region manifests for snaptb0-testConsecutiveExports at 1689675073589Writing data manifest for snaptb0-testConsecutiveExports at 1689675073593 (+4 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1689675073604 (+11 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689675073639 (+35 ms) 2023-07-18 10:11:13,643 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-18 10:11:13,645 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 218 msec 2023-07-18 10:11:13,728 DEBUG [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 10:11:13,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-18 10:11:13,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-18 10:11:13,730 INFO [Listener at jenkins-hbase4.apache.org/34477] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c329d283-1f43-4a99-3860-7ed90b9830ca/local-export-1689675073730 2023-07-18 10:11:13,730 INFO [Listener at jenkins-hbase4.apache.org/34477] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c329d283-1f43-4a99-3860-7ed90b9830ca/local-export-1689675073730, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c329d283-1f43-4a99-3860-7ed90b9830ca/local-export-1689675073730, srcFsUri=hdfs://localhost:44811, srcDir=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427 2023-07-18 10:11:13,771 DEBUG [Listener at jenkins-hbase4.apache.org/34477] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44811, inputRoot=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427 2023-07-18 10:11:13,771 DEBUG [Listener at jenkins-hbase4.apache.org/34477] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@37043c6c, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c329d283-1f43-4a99-3860-7ed90b9830ca/local-export-1689675073730, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c329d283-1f43-4a99-3860-7ed90b9830ca/local-export-1689675073730/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-18 10:11:13,771 INFO [Listener at jenkins-hbase4.apache.org/34477] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44811, inputRoot=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427, snapshotDir=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-18 10:11:13,782 INFO [Listener at jenkins-hbase4.apache.org/34477] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c329d283-1f43-4a99-3860-7ed90b9830ca/local-export-1689675073730/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-18 10:11:13,801 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-18 10:11:13,802 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-18 10:11:13,802 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-18 10:11:13,803 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-18 10:11:13,803 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-18 10:11:13,804 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-18 10:11:13,804 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-18 10:11:13,905 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c329d283-1f43-4a99-3860-7ed90b9830ca/hadoop-4917643435076056860.jar 2023-07-18 10:11:13,906 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-18 10:11:13,906 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-18 10:11:13,907 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-18 10:11:13,907 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-18 10:11:13,908 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-18 10:11:13,908 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-18 10:11:13,909 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-18 10:11:13,909 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-18 10:11:13,910 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-18 10:11:13,911 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-18 10:11:13,911 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-18 10:11:13,912 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-18 10:11:13,912 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-18 10:11:13,913 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-18 10:11:13,913 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-18 10:11:13,914 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-18 10:11:13,915 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 10:11:13,915 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 10:11:13,916 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 10:11:13,916 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 10:11:13,916 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 10:11:13,917 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 10:11:13,918 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 10:11:14,448 WARN [Listener at jenkins-hbase4.apache.org/34477] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-18 10:11:14,451 INFO [Listener at jenkins-hbase4.apache.org/34477] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-18 10:11:14,453 DEBUG [Listener at jenkins-hbase4.apache.org/34477] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-18 10:11:16,998 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 10:11:16,998 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 10:11:17,001 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689675035640_0002_000001 (auth:SIMPLE) 2023-07-18 10:11:17,639 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689675035640_0003_000001 (auth:SIMPLE) 2023-07-18 10:11:17,673 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-18 10:11:22,384 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689675035640_0003_000001 (auth:SIMPLE) 2023-07-18 10:11:24,600 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689675035640_0003_000001 (auth:SIMPLE) 2023-07-18 10:11:27,459 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689675035640_0003_000001 (auth:SIMPLE) 2023-07-18 10:11:28,646 INFO [Listener at jenkins-hbase4.apache.org/34477] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-18 10:11:28,647 INFO [Listener at jenkins-hbase4.apache.org/34477] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-18 10:11:28,651 INFO [Listener at jenkins-hbase4.apache.org/34477] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-18 10:11:28,651 INFO [Listener at jenkins-hbase4.apache.org/34477] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-18 10:11:28,652 INFO [Listener at jenkins-hbase4.apache.org/34477] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-18 10:11:28,652 DEBUG [Listener at jenkins-hbase4.apache.org/34477] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_307542026_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-18 10:11:28,654 DEBUG [Listener at jenkins-hbase4.apache.org/34477] snapshot.TestExportSnapshot(367): hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-18 10:11:28,654 DEBUG [Listener at jenkins-hbase4.apache.org/34477] snapshot.TestExportSnapshot(367): hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-18 10:11:28,654 DEBUG [Listener at jenkins-hbase4.apache.org/34477] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@16eb5e30 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c329d283-1f43-4a99-3860-7ed90b9830ca/local-export-1689675073730/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c329d283-1f43-4a99-3860-7ed90b9830ca/local-export-1689675073730/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-18 10:11:28,654 DEBUG [Listener at jenkins-hbase4.apache.org/34477] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c329d283-1f43-4a99-3860-7ed90b9830ca/local-export-1689675073730/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-18 10:11:28,655 DEBUG [Listener at jenkins-hbase4.apache.org/34477] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c329d283-1f43-4a99-3860-7ed90b9830ca/local-export-1689675073730/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-18 10:11:28,656 INFO [Listener at jenkins-hbase4.apache.org/34477] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c329d283-1f43-4a99-3860-7ed90b9830ca/local-export-1689675073730, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c329d283-1f43-4a99-3860-7ed90b9830ca/local-export-1689675073730, srcFsUri=hdfs://localhost:44811, srcDir=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427 2023-07-18 10:11:28,677 DEBUG [Listener at jenkins-hbase4.apache.org/34477] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44811, inputRoot=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427 2023-07-18 10:11:28,677 DEBUG [Listener at jenkins-hbase4.apache.org/34477] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@38894d05, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c329d283-1f43-4a99-3860-7ed90b9830ca/local-export-1689675073730, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c329d283-1f43-4a99-3860-7ed90b9830ca/local-export-1689675073730/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-18 10:11:28,677 INFO [Listener at jenkins-hbase4.apache.org/34477] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44811, inputRoot=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427, snapshotDir=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-18 10:11:28,691 INFO [Listener at jenkins-hbase4.apache.org/34477] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c329d283-1f43-4a99-3860-7ed90b9830ca/local-export-1689675073730/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-18 10:11:28,703 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-18 10:11:28,704 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-18 10:11:28,704 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-18 10:11:28,704 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-18 10:11:28,705 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-18 10:11:28,705 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-18 10:11:28,706 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-18 10:11:28,775 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c329d283-1f43-4a99-3860-7ed90b9830ca/hadoop-3246596293035849184.jar 2023-07-18 10:11:28,776 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-18 10:11:28,776 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-18 10:11:28,776 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-18 10:11:28,777 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-18 10:11:28,777 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-18 10:11:28,777 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-18 10:11:28,778 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-18 10:11:28,778 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-18 10:11:28,778 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-18 10:11:28,779 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-18 10:11:28,779 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-18 10:11:28,780 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-18 10:11:28,780 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-18 10:11:28,780 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-18 10:11:28,780 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-18 10:11:28,781 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-18 10:11:28,781 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 10:11:28,782 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 10:11:28,782 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 10:11:28,782 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 10:11:28,783 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 10:11:28,783 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 10:11:28,783 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 10:11:29,176 WARN [Listener at jenkins-hbase4.apache.org/34477] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-18 10:11:29,178 INFO [Listener at jenkins-hbase4.apache.org/34477] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-18 10:11:29,180 DEBUG [Listener at jenkins-hbase4.apache.org/34477] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-18 10:11:33,652 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 10:11:33,652 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 10:11:33,655 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689675035640_0003_000001 (auth:SIMPLE) 2023-07-18 10:11:34,013 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689675035640_0004_000001 (auth:SIMPLE) 2023-07-18 10:11:38,679 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689675035640_0004_000001 (auth:SIMPLE) 2023-07-18 10:11:40,912 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689675035640_0004_000001 (auth:SIMPLE) 2023-07-18 10:11:45,475 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689675035640_0004_000001 (auth:SIMPLE) 2023-07-18 10:11:47,395 INFO [Listener at jenkins-hbase4.apache.org/34477] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-18 10:11:47,395 INFO [Listener at jenkins-hbase4.apache.org/34477] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-18 10:11:47,398 INFO [Listener at jenkins-hbase4.apache.org/34477] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-18 10:11:47,398 INFO [Listener at jenkins-hbase4.apache.org/34477] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-18 10:11:47,399 INFO [Listener at jenkins-hbase4.apache.org/34477] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-18 10:11:47,399 DEBUG [Listener at jenkins-hbase4.apache.org/34477] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_307542026_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-18 10:11:47,401 DEBUG [Listener at jenkins-hbase4.apache.org/34477] snapshot.TestExportSnapshot(367): hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-18 10:11:47,402 DEBUG [Listener at jenkins-hbase4.apache.org/34477] snapshot.TestExportSnapshot(367): hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-18 10:11:47,402 DEBUG [Listener at jenkins-hbase4.apache.org/34477] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@16eb5e30 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c329d283-1f43-4a99-3860-7ed90b9830ca/local-export-1689675073730/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c329d283-1f43-4a99-3860-7ed90b9830ca/local-export-1689675073730/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-18 10:11:47,402 DEBUG [Listener at jenkins-hbase4.apache.org/34477] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c329d283-1f43-4a99-3860-7ed90b9830ca/local-export-1689675073730/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-18 10:11:47,402 DEBUG [Listener at jenkins-hbase4.apache.org/34477] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c329d283-1f43-4a99-3860-7ed90b9830ca/local-export-1689675073730/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-18 10:11:47,419 INFO [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-18 10:11:47,422 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-07-18 10:11:47,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-18 10:11:47,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-18 10:11:47,432 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689675107431"}]},"ts":"1689675107431"} 2023-07-18 10:11:47,433 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-18 10:11:47,435 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-18 10:11:47,436 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=33c1fe5cf475cbb2491ecc6f45fe23b0, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0519db478ba158ce7de46b65ff5faf62, UNASSIGN}] 2023-07-18 10:11:47,438 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=33c1fe5cf475cbb2491ecc6f45fe23b0, UNASSIGN 2023-07-18 10:11:47,439 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0519db478ba158ce7de46b65ff5faf62, UNASSIGN 2023-07-18 10:11:47,439 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=0519db478ba158ce7de46b65ff5faf62, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:11:47,439 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=33c1fe5cf475cbb2491ecc6f45fe23b0, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:47,440 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689675072401.0519db478ba158ce7de46b65ff5faf62.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689675107439"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689675107439"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689675107439"}]},"ts":"1689675107439"} 2023-07-18 10:11:47,440 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689675072401.33c1fe5cf475cbb2491ecc6f45fe23b0.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689675107439"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689675107439"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689675107439"}]},"ts":"1689675107439"} 2023-07-18 10:11:47,441 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=53, state=RUNNABLE; CloseRegionProcedure 0519db478ba158ce7de46b65ff5faf62, server=jenkins-hbase4.apache.org,39709,1689675027617}] 2023-07-18 10:11:47,445 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=52, state=RUNNABLE; CloseRegionProcedure 33c1fe5cf475cbb2491ecc6f45fe23b0, server=jenkins-hbase4.apache.org,37417,1689675027545}] 2023-07-18 10:11:47,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-18 10:11:47,594 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 0519db478ba158ce7de46b65ff5faf62 2023-07-18 10:11:47,594 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0519db478ba158ce7de46b65ff5faf62, disabling compactions & flushes 2023-07-18 10:11:47,594 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689675072401.0519db478ba158ce7de46b65ff5faf62. 2023-07-18 10:11:47,594 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689675072401.0519db478ba158ce7de46b65ff5faf62. 2023-07-18 10:11:47,594 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689675072401.0519db478ba158ce7de46b65ff5faf62. after waiting 0 ms 2023-07-18 10:11:47,594 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689675072401.0519db478ba158ce7de46b65ff5faf62. 2023-07-18 10:11:47,599 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 33c1fe5cf475cbb2491ecc6f45fe23b0 2023-07-18 10:11:47,599 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 33c1fe5cf475cbb2491ecc6f45fe23b0, disabling compactions & flushes 2023-07-18 10:11:47,600 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689675072401.33c1fe5cf475cbb2491ecc6f45fe23b0. 2023-07-18 10:11:47,600 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689675072401.33c1fe5cf475cbb2491ecc6f45fe23b0. 2023-07-18 10:11:47,600 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689675072401.33c1fe5cf475cbb2491ecc6f45fe23b0. after waiting 0 ms 2023-07-18 10:11:47,600 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689675072401.33c1fe5cf475cbb2491ecc6f45fe23b0. 2023-07-18 10:11:47,610 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testConsecutiveExports/0519db478ba158ce7de46b65ff5faf62/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-18 10:11:47,610 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testConsecutiveExports/33c1fe5cf475cbb2491ecc6f45fe23b0/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-18 10:11:47,610 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 10:11:47,611 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 10:11:47,612 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689675072401.33c1fe5cf475cbb2491ecc6f45fe23b0. 2023-07-18 10:11:47,612 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689675072401.0519db478ba158ce7de46b65ff5faf62. 2023-07-18 10:11:47,613 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0519db478ba158ce7de46b65ff5faf62: 2023-07-18 10:11:47,613 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 33c1fe5cf475cbb2491ecc6f45fe23b0: 2023-07-18 10:11:47,616 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 0519db478ba158ce7de46b65ff5faf62 2023-07-18 10:11:47,616 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=0519db478ba158ce7de46b65ff5faf62, regionState=CLOSED 2023-07-18 10:11:47,616 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 33c1fe5cf475cbb2491ecc6f45fe23b0 2023-07-18 10:11:47,617 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689675072401.0519db478ba158ce7de46b65ff5faf62.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689675107616"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689675107616"}]},"ts":"1689675107616"} 2023-07-18 10:11:47,617 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=33c1fe5cf475cbb2491ecc6f45fe23b0, regionState=CLOSED 2023-07-18 10:11:47,617 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689675072401.33c1fe5cf475cbb2491ecc6f45fe23b0.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689675107617"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689675107617"}]},"ts":"1689675107617"} 2023-07-18 10:11:47,621 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=53 2023-07-18 10:11:47,622 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=53, state=SUCCESS; CloseRegionProcedure 0519db478ba158ce7de46b65ff5faf62, server=jenkins-hbase4.apache.org,39709,1689675027617 in 177 msec 2023-07-18 10:11:47,623 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=52 2023-07-18 10:11:47,623 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=52, state=SUCCESS; CloseRegionProcedure 33c1fe5cf475cbb2491ecc6f45fe23b0, server=jenkins-hbase4.apache.org,37417,1689675027545 in 175 msec 2023-07-18 10:11:47,623 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0519db478ba158ce7de46b65ff5faf62, UNASSIGN in 186 msec 2023-07-18 10:11:47,624 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=51 2023-07-18 10:11:47,624 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=33c1fe5cf475cbb2491ecc6f45fe23b0, UNASSIGN in 187 msec 2023-07-18 10:11:47,625 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689675107625"}]},"ts":"1689675107625"} 2023-07-18 10:11:47,626 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-18 10:11:47,629 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-18 10:11:47,631 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 208 msec 2023-07-18 10:11:47,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-18 10:11:47,732 INFO [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-18 10:11:47,734 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-07-18 10:11:47,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-18 10:11:47,738 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-18 10:11:47,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-18 10:11:47,739 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-18 10:11:47,747 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43301] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-18 10:11:47,751 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-18 10:11:47,751 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-18 10:11:47,751 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-18 10:11:47,751 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-18 10:11:47,752 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-18 10:11:47,752 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-18 10:11:47,753 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-18 10:11:47,754 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-18 10:11:47,755 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-18 10:11:47,755 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-18 10:11:47,755 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:11:47,755 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-18 10:11:47,755 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-18 10:11:47,755 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:11:47,755 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:11:47,755 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:11:47,757 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testConsecutiveExports/33c1fe5cf475cbb2491ecc6f45fe23b0 2023-07-18 10:11:47,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-18 10:11:47,758 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testConsecutiveExports/0519db478ba158ce7de46b65ff5faf62 2023-07-18 10:11:47,760 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testConsecutiveExports/33c1fe5cf475cbb2491ecc6f45fe23b0/cf, FileablePath, hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testConsecutiveExports/33c1fe5cf475cbb2491ecc6f45fe23b0/recovered.edits] 2023-07-18 10:11:47,761 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testConsecutiveExports/0519db478ba158ce7de46b65ff5faf62/cf, FileablePath, hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testConsecutiveExports/0519db478ba158ce7de46b65ff5faf62/recovered.edits] 2023-07-18 10:11:47,765 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testConsecutiveExports/33c1fe5cf475cbb2491ecc6f45fe23b0/cf/42fa449e3dc6463494e90865b0dbe7fc to hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/archive/data/default/testtb-testConsecutiveExports/33c1fe5cf475cbb2491ecc6f45fe23b0/cf/42fa449e3dc6463494e90865b0dbe7fc 2023-07-18 10:11:47,766 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testConsecutiveExports/0519db478ba158ce7de46b65ff5faf62/cf/06ecc9adb7494a36ba47a52192f9162c to hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/archive/data/default/testtb-testConsecutiveExports/0519db478ba158ce7de46b65ff5faf62/cf/06ecc9adb7494a36ba47a52192f9162c 2023-07-18 10:11:47,772 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testConsecutiveExports/33c1fe5cf475cbb2491ecc6f45fe23b0/recovered.edits/9.seqid to hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/archive/data/default/testtb-testConsecutiveExports/33c1fe5cf475cbb2491ecc6f45fe23b0/recovered.edits/9.seqid 2023-07-18 10:11:47,772 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testConsecutiveExports/0519db478ba158ce7de46b65ff5faf62/recovered.edits/9.seqid to hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/archive/data/default/testtb-testConsecutiveExports/0519db478ba158ce7de46b65ff5faf62/recovered.edits/9.seqid 2023-07-18 10:11:47,773 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testConsecutiveExports/33c1fe5cf475cbb2491ecc6f45fe23b0 2023-07-18 10:11:47,773 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testConsecutiveExports/0519db478ba158ce7de46b65ff5faf62 2023-07-18 10:11:47,773 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-18 10:11:47,773 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-18 10:11:47,774 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-07-18 10:11:47,779 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230718e0c8450da28842b6a993f161082525a6 to hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230718e0c8450da28842b6a993f161082525a6 2023-07-18 10:11:47,781 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023071882831507974c462ab088bbdae2dd1354 to hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023071882831507974c462ab088bbdae2dd1354 2023-07-18 10:11:47,781 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-18 10:11:47,784 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-18 10:11:47,787 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-18 10:11:47,793 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-18 10:11:47,796 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-18 10:11:47,796 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-18 10:11:47,796 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1689675072401.33c1fe5cf475cbb2491ecc6f45fe23b0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689675107796"}]},"ts":"9223372036854775807"} 2023-07-18 10:11:47,796 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1689675072401.0519db478ba158ce7de46b65ff5faf62.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689675107796"}]},"ts":"9223372036854775807"} 2023-07-18 10:11:47,798 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-18 10:11:47,798 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 33c1fe5cf475cbb2491ecc6f45fe23b0, NAME => 'testtb-testConsecutiveExports,,1689675072401.33c1fe5cf475cbb2491ecc6f45fe23b0.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 0519db478ba158ce7de46b65ff5faf62, NAME => 'testtb-testConsecutiveExports,1,1689675072401.0519db478ba158ce7de46b65ff5faf62.', STARTKEY => '1', ENDKEY => ''}] 2023-07-18 10:11:47,798 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-18 10:11:47,798 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689675107798"}]},"ts":"9223372036854775807"} 2023-07-18 10:11:47,806 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-18 10:11:47,815 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-18 10:11:47,816 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 81 msec 2023-07-18 10:11:47,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-18 10:11:47,859 INFO [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-18 10:11:47,868 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-18 10:11:47,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-18 10:11:47,876 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-07-18 10:11:47,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-18 10:11:47,904 INFO [Listener at jenkins-hbase4.apache.org/34477] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=744 (was 766), OpenFileDescriptor=897 (was 926), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=425 (was 399) - SystemLoadAverage LEAK? -, ProcessCount=184 (was 183) - ProcessCount LEAK? -, AvailableMemoryMB=2376 (was 2848) 2023-07-18 10:11:47,904 WARN [Listener at jenkins-hbase4.apache.org/34477] hbase.ResourceChecker(130): Thread=744 is superior to 500 2023-07-18 10:11:47,924 INFO [Listener at jenkins-hbase4.apache.org/34477] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=744, OpenFileDescriptor=897, MaxFileDescriptor=60000, SystemLoadAverage=425, ProcessCount=184, AvailableMemoryMB=2372 2023-07-18 10:11:47,924 WARN [Listener at jenkins-hbase4.apache.org/34477] hbase.ResourceChecker(130): Thread=744 is superior to 500 2023-07-18 10:11:47,926 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-18 10:11:47,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:47,930 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-18 10:11:47,930 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-18 10:11:47,931 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-18 10:11:47,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-18 10:11:47,934 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d76d20d2003fd3fe909413d09bad137e 2023-07-18 10:11:47,934 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/30ce7c205ed3f723a7370424f91dd153 2023-07-18 10:11:47,934 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d76d20d2003fd3fe909413d09bad137e empty. 2023-07-18 10:11:47,934 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/30ce7c205ed3f723a7370424f91dd153 empty. 2023-07-18 10:11:47,935 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d76d20d2003fd3fe909413d09bad137e 2023-07-18 10:11:47,935 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/30ce7c205ed3f723a7370424f91dd153 2023-07-18 10:11:47,935 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-18 10:11:47,948 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-18 10:11:47,949 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => d76d20d2003fd3fe909413d09bad137e, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689675107926.d76d20d2003fd3fe909413d09bad137e.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp 2023-07-18 10:11:47,950 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 30ce7c205ed3f723a7370424f91dd153, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689675107926.30ce7c205ed3f723a7370424f91dd153.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp 2023-07-18 10:11:47,967 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689675107926.d76d20d2003fd3fe909413d09bad137e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 10:11:47,968 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing d76d20d2003fd3fe909413d09bad137e, disabling compactions & flushes 2023-07-18 10:11:47,968 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689675107926.d76d20d2003fd3fe909413d09bad137e. 2023-07-18 10:11:47,968 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689675107926.d76d20d2003fd3fe909413d09bad137e. 2023-07-18 10:11:47,968 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689675107926.d76d20d2003fd3fe909413d09bad137e. after waiting 0 ms 2023-07-18 10:11:47,968 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689675107926.d76d20d2003fd3fe909413d09bad137e. 2023-07-18 10:11:47,968 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689675107926.d76d20d2003fd3fe909413d09bad137e. 2023-07-18 10:11:47,968 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for d76d20d2003fd3fe909413d09bad137e: 2023-07-18 10:11:47,971 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689675107926.30ce7c205ed3f723a7370424f91dd153.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 10:11:47,971 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 30ce7c205ed3f723a7370424f91dd153, disabling compactions & flushes 2023-07-18 10:11:47,971 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689675107926.30ce7c205ed3f723a7370424f91dd153. 2023-07-18 10:11:47,971 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689675107926.30ce7c205ed3f723a7370424f91dd153. 2023-07-18 10:11:47,971 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689675107926.30ce7c205ed3f723a7370424f91dd153. after waiting 0 ms 2023-07-18 10:11:47,971 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689675107926.30ce7c205ed3f723a7370424f91dd153. 2023-07-18 10:11:47,971 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689675107926.30ce7c205ed3f723a7370424f91dd153. 2023-07-18 10:11:47,971 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 30ce7c205ed3f723a7370424f91dd153: 2023-07-18 10:11:47,974 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-18 10:11:47,975 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689675107926.d76d20d2003fd3fe909413d09bad137e.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689675107975"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689675107975"}]},"ts":"1689675107975"} 2023-07-18 10:11:47,975 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689675107926.30ce7c205ed3f723a7370424f91dd153.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689675107975"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689675107975"}]},"ts":"1689675107975"} 2023-07-18 10:11:47,981 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-18 10:11:47,982 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-18 10:11:47,982 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689675107982"}]},"ts":"1689675107982"} 2023-07-18 10:11:47,983 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-18 10:11:47,989 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 10:11:47,991 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 10:11:47,991 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 10:11:47,991 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-18 10:11:47,991 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 10:11:47,991 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=d76d20d2003fd3fe909413d09bad137e, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=30ce7c205ed3f723a7370424f91dd153, ASSIGN}] 2023-07-18 10:11:47,994 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=30ce7c205ed3f723a7370424f91dd153, ASSIGN 2023-07-18 10:11:47,995 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=d76d20d2003fd3fe909413d09bad137e, ASSIGN 2023-07-18 10:11:47,996 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=30ce7c205ed3f723a7370424f91dd153, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37417,1689675027545; forceNewPlan=false, retain=false 2023-07-18 10:11:47,996 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=d76d20d2003fd3fe909413d09bad137e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43301,1689675027670; forceNewPlan=false, retain=false 2023-07-18 10:11:48,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-18 10:11:48,146 INFO [jenkins-hbase4:38235] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-18 10:11:48,149 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=30ce7c205ed3f723a7370424f91dd153, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:48,149 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=d76d20d2003fd3fe909413d09bad137e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:11:48,150 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689675107926.30ce7c205ed3f723a7370424f91dd153.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689675108149"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689675108149"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689675108149"}]},"ts":"1689675108149"} 2023-07-18 10:11:48,150 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689675107926.d76d20d2003fd3fe909413d09bad137e.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689675108149"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689675108149"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689675108149"}]},"ts":"1689675108149"} 2023-07-18 10:11:48,159 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure 30ce7c205ed3f723a7370424f91dd153, server=jenkins-hbase4.apache.org,37417,1689675027545}] 2023-07-18 10:11:48,162 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure d76d20d2003fd3fe909413d09bad137e, server=jenkins-hbase4.apache.org,43301,1689675027670}] 2023-07-18 10:11:48,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-18 10:11:48,323 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1689675107926.30ce7c205ed3f723a7370424f91dd153. 2023-07-18 10:11:48,323 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 30ce7c205ed3f723a7370424f91dd153, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689675107926.30ce7c205ed3f723a7370424f91dd153.', STARTKEY => '1', ENDKEY => ''} 2023-07-18 10:11:48,323 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1689675107926.30ce7c205ed3f723a7370424f91dd153. service=AccessControlService 2023-07-18 10:11:48,324 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 10:11:48,324 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 30ce7c205ed3f723a7370424f91dd153 2023-07-18 10:11:48,324 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689675107926.30ce7c205ed3f723a7370424f91dd153.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 10:11:48,324 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1689675107926.d76d20d2003fd3fe909413d09bad137e. 2023-07-18 10:11:48,324 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 30ce7c205ed3f723a7370424f91dd153 2023-07-18 10:11:48,324 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 30ce7c205ed3f723a7370424f91dd153 2023-07-18 10:11:48,324 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d76d20d2003fd3fe909413d09bad137e, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689675107926.d76d20d2003fd3fe909413d09bad137e.', STARTKEY => '', ENDKEY => '1'} 2023-07-18 10:11:48,324 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1689675107926.d76d20d2003fd3fe909413d09bad137e. service=AccessControlService 2023-07-18 10:11:48,324 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 10:11:48,325 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion d76d20d2003fd3fe909413d09bad137e 2023-07-18 10:11:48,325 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689675107926.d76d20d2003fd3fe909413d09bad137e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 10:11:48,325 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d76d20d2003fd3fe909413d09bad137e 2023-07-18 10:11:48,325 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d76d20d2003fd3fe909413d09bad137e 2023-07-18 10:11:48,327 INFO [StoreOpener-30ce7c205ed3f723a7370424f91dd153-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 30ce7c205ed3f723a7370424f91dd153 2023-07-18 10:11:48,327 INFO [StoreOpener-d76d20d2003fd3fe909413d09bad137e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region d76d20d2003fd3fe909413d09bad137e 2023-07-18 10:11:48,328 DEBUG [StoreOpener-30ce7c205ed3f723a7370424f91dd153-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemStateWithMergeRegion/30ce7c205ed3f723a7370424f91dd153/cf 2023-07-18 10:11:48,328 DEBUG [StoreOpener-30ce7c205ed3f723a7370424f91dd153-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemStateWithMergeRegion/30ce7c205ed3f723a7370424f91dd153/cf 2023-07-18 10:11:48,328 DEBUG [StoreOpener-d76d20d2003fd3fe909413d09bad137e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemStateWithMergeRegion/d76d20d2003fd3fe909413d09bad137e/cf 2023-07-18 10:11:48,329 DEBUG [StoreOpener-d76d20d2003fd3fe909413d09bad137e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemStateWithMergeRegion/d76d20d2003fd3fe909413d09bad137e/cf 2023-07-18 10:11:48,329 INFO [StoreOpener-d76d20d2003fd3fe909413d09bad137e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d76d20d2003fd3fe909413d09bad137e columnFamilyName cf 2023-07-18 10:11:48,329 INFO [StoreOpener-30ce7c205ed3f723a7370424f91dd153-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 30ce7c205ed3f723a7370424f91dd153 columnFamilyName cf 2023-07-18 10:11:48,331 INFO [StoreOpener-30ce7c205ed3f723a7370424f91dd153-1] regionserver.HStore(310): Store=30ce7c205ed3f723a7370424f91dd153/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 10:11:48,331 INFO [StoreOpener-d76d20d2003fd3fe909413d09bad137e-1] regionserver.HStore(310): Store=d76d20d2003fd3fe909413d09bad137e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 10:11:48,332 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemStateWithMergeRegion/d76d20d2003fd3fe909413d09bad137e 2023-07-18 10:11:48,332 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemStateWithMergeRegion/30ce7c205ed3f723a7370424f91dd153 2023-07-18 10:11:48,333 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemStateWithMergeRegion/d76d20d2003fd3fe909413d09bad137e 2023-07-18 10:11:48,333 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemStateWithMergeRegion/30ce7c205ed3f723a7370424f91dd153 2023-07-18 10:11:48,336 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 30ce7c205ed3f723a7370424f91dd153 2023-07-18 10:11:48,336 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d76d20d2003fd3fe909413d09bad137e 2023-07-18 10:11:48,338 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemStateWithMergeRegion/30ce7c205ed3f723a7370424f91dd153/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 10:11:48,339 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemStateWithMergeRegion/d76d20d2003fd3fe909413d09bad137e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 10:11:48,339 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 30ce7c205ed3f723a7370424f91dd153; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60141790, jitterRate=-0.10381749272346497}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 10:11:48,340 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 30ce7c205ed3f723a7370424f91dd153: 2023-07-18 10:11:48,340 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d76d20d2003fd3fe909413d09bad137e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70386223, jitterRate=0.04883645474910736}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 10:11:48,340 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d76d20d2003fd3fe909413d09bad137e: 2023-07-18 10:11:48,340 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1689675107926.d76d20d2003fd3fe909413d09bad137e., pid=61, masterSystemTime=1689675108316 2023-07-18 10:11:48,340 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1689675107926.30ce7c205ed3f723a7370424f91dd153., pid=60, masterSystemTime=1689675108315 2023-07-18 10:11:48,342 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1689675107926.d76d20d2003fd3fe909413d09bad137e. 2023-07-18 10:11:48,342 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1689675107926.d76d20d2003fd3fe909413d09bad137e. 2023-07-18 10:11:48,347 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=d76d20d2003fd3fe909413d09bad137e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:11:48,347 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689675107926.d76d20d2003fd3fe909413d09bad137e.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689675108347"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689675108347"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689675108347"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689675108347"}]},"ts":"1689675108347"} 2023-07-18 10:11:48,348 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=30ce7c205ed3f723a7370424f91dd153, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:48,348 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689675107926.30ce7c205ed3f723a7370424f91dd153.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689675108348"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689675108348"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689675108348"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689675108348"}]},"ts":"1689675108348"} 2023-07-18 10:11:48,350 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1689675107926.30ce7c205ed3f723a7370424f91dd153. 2023-07-18 10:11:48,351 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1689675107926.30ce7c205ed3f723a7370424f91dd153. 2023-07-18 10:11:48,352 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=58 2023-07-18 10:11:48,352 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure d76d20d2003fd3fe909413d09bad137e, server=jenkins-hbase4.apache.org,43301,1689675027670 in 187 msec 2023-07-18 10:11:48,353 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=59 2023-07-18 10:11:48,353 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure 30ce7c205ed3f723a7370424f91dd153, server=jenkins-hbase4.apache.org,37417,1689675027545 in 191 msec 2023-07-18 10:11:48,355 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=d76d20d2003fd3fe909413d09bad137e, ASSIGN in 362 msec 2023-07-18 10:11:48,356 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=59, resume processing ppid=57 2023-07-18 10:11:48,356 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=30ce7c205ed3f723a7370424f91dd153, ASSIGN in 362 msec 2023-07-18 10:11:48,357 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-18 10:11:48,357 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689675108357"}]},"ts":"1689675108357"} 2023-07-18 10:11:48,359 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-18 10:11:48,361 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-18 10:11:48,362 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-18 10:11:48,364 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43301] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-18 10:11:48,371 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:11:48,371 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:11:48,371 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:11:48,371 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:11:48,373 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-18 10:11:48,373 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-18 10:11:48,373 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-18 10:11:48,373 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-18 10:11:48,375 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 447 msec 2023-07-18 10:11:48,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-18 10:11:48,535 INFO [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-18 10:11:48,537 DEBUG [Listener at jenkins-hbase4.apache.org/34477] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:48,537 DEBUG [Listener at jenkins-hbase4.apache.org/34477] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689675107926.d76d20d2003fd3fe909413d09bad137e. 2023-07-18 10:11:48,539 INFO [Listener at jenkins-hbase4.apache.org/34477] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 10:11:48,556 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-18 10:11:48,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689675108556 (current time:1689675108556). 2023-07-18 10:11:48,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-18 10:11:48,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] zookeeper.ReadOnlyZKClient(139): Connect 0x7c5bbb5f to 127.0.0.1:60990 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 10:11:48,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3f8316f6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 10:11:48,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 10:11:48,569 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35604, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 10:11:48,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7c5bbb5f to 127.0.0.1:60990 2023-07-18 10:11:48,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 10:11:48,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] zookeeper.ReadOnlyZKClient(139): Connect 0x462d8f9c to 127.0.0.1:60990 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 10:11:48,577 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@670d5545, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 10:11:48,579 DEBUG [hconnection-0x409ecbf4-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 10:11:48,580 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35610, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 10:11:48,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 10:11:48,585 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55056, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 10:11:48,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x462d8f9c to 127.0.0.1:60990 2023-07-18 10:11:48,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 10:11:48,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-18 10:11:48,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-18 10:11:48,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-18 10:11:48,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-18 10:11:48,591 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-18 10:11:48,592 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689675708592 2023-07-18 10:11:48,592 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:48,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-18 10:11:48,593 DEBUG [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-18 10:11:48,593 DEBUG [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-18 10:11:48,595 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-18 10:11:48,595 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-18 10:11:48,597 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 6 msec 2023-07-18 10:11:48,598 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-18 10:11:48,598 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689675708598 2023-07-18 10:11:48,612 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:48,612 INFO [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-18 10:11:48,612 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:11:48,613 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-18 10:11:48,613 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-18 10:11:48,613 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:48,613 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:48,615 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:11:48,615 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:11:48,615 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:11:48,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:11:48,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:11:48,615 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:11:48,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:11:48,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:11:48,615 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:11:48,615 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:48,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:11:48,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:11:48,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:48,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:48,616 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:48,616 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-18 10:11:48,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:48,616 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:48,616 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:48,616 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:48,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-18 10:11:48,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:48,616 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-18 10:11:48,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-18 10:11:48,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:48,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-18 10:11:48,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:48,617 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-18 10:11:48,617 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-18 10:11:48,618 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:48,618 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-18 10:11:48,618 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:48,618 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:48,618 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-18 10:11:48,618 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-18 10:11:48,618 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:11:48,618 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:11:48,619 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-18 10:11:48,620 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-18 10:11:48,620 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-18 10:11:48,618 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:11:48,620 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39709,1689675027617' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-18 10:11:48,621 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-18 10:11:48,621 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-18 10:11:48,621 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43301,1689675027670' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-18 10:11:48,620 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-18 10:11:48,621 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37417,1689675027545' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-18 10:11:48,623 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:48,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:48,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:11:48,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:11:48,623 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:48,624 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:48,624 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:11:48,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:11:48,625 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:48,625 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:48,625 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 10:11:48,625 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:48,625 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 10:11:48,625 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:48,625 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 10:11:48,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:11:48,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:48,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:11:48,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:48,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:11:48,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:11:48,628 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37417,1689675027545' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-18 10:11:48,628 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7b49bb93[Count = 1] remaining members to acquire global barrier 2023-07-18 10:11:48,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:11:48,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:11:48,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:11:48,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:11:48,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:11:48,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:48,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:11:48,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:48,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:11:48,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:11:48,630 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43301,1689675027670' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-18 10:11:48,630 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7b49bb93[Count = 0] remaining members to acquire global barrier 2023-07-18 10:11:48,630 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-18 10:11:48,630 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:48,631 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:48,631 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:48,631 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:48,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:48,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:48,632 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:48,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:48,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:48,632 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-18 10:11:48,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:48,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:48,632 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:11:48,632 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 10:11:48,632 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 10:11:48,632 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-18 10:11:48,632 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-18 10:11:48,632 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-18 10:11:48,632 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,39709,1689675027617' in zk 2023-07-18 10:11:48,632 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-18 10:11:48,632 DEBUG [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689675107926.d76d20d2003fd3fe909413d09bad137e. 2023-07-18 10:11:48,633 DEBUG [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689675107926.d76d20d2003fd3fe909413d09bad137e. started... 2023-07-18 10:11:48,633 DEBUG [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d76d20d2003fd3fe909413d09bad137e: 2023-07-18 10:11:48,633 DEBUG [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689675107926.d76d20d2003fd3fe909413d09bad137e.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:48,633 DEBUG [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 10:11:48,633 DEBUG [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-18 10:11:48,634 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 10:11:48,634 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 10:11:48,635 DEBUG [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689675107926.30ce7c205ed3f723a7370424f91dd153. 2023-07-18 10:11:48,635 DEBUG [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689675107926.30ce7c205ed3f723a7370424f91dd153. started... 2023-07-18 10:11:48,636 DEBUG [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 30ce7c205ed3f723a7370424f91dd153: 2023-07-18 10:11:48,637 DEBUG [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689675107926.30ce7c205ed3f723a7370424f91dd153.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:48,637 DEBUG [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 10:11:48,637 DEBUG [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-18 10:11:48,644 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-18 10:11:48,644 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:11:48,644 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-18 10:11:48,679 DEBUG [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689675107926.30ce7c205ed3f723a7370424f91dd153. completed. 2023-07-18 10:11:48,679 DEBUG [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689675107926.30ce7c205ed3f723a7370424f91dd153. 2023-07-18 10:11:48,679 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 10:11:48,680 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 10:11:48,680 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:48,680 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-18 10:11:48,680 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,37417,1689675027545' in zk 2023-07-18 10:11:48,683 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:48,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:48,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:11:48,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:11:48,683 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-18 10:11:48,683 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:11:48,683 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-18 10:11:48,685 DEBUG [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689675107926.d76d20d2003fd3fe909413d09bad137e. completed. 2023-07-18 10:11:48,685 DEBUG [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689675107926.d76d20d2003fd3fe909413d09bad137e. 2023-07-18 10:11:48,685 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 10:11:48,685 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 10:11:48,685 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:11:48,685 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-18 10:11:48,685 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,43301,1689675027670' in zk 2023-07-18 10:11:48,693 DEBUG [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 10:11:48,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:11:48,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-18 10:11:48,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-18 10:11:48,697 DEBUG [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-18 10:11:48,698 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:11:48,698 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-18 10:11:48,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:11:48,698 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:11:48,698 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-18 10:11:48,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:48,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:11:48,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:48,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:11:48,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:11:48,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:48,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:11:48,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:48,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:11:48,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,37417,1689675027545': 2023-07-18 10:11:48,703 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37417,1689675027545' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-18 10:11:48,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:11:48,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:11:48,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:11:48,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:11:48,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:11:48,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:48,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:11:48,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:48,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:11:48,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:11:48,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:48,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:11:48,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:48,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:11:48,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,43301,1689675027670': 2023-07-18 10:11:48,711 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43301,1689675027670' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-18 10:11:48,711 INFO [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-18 10:11:48,712 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-18 10:11:48,712 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-18 10:11:48,712 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:48,712 INFO [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-18 10:11:48,714 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:48,714 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:48,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:48,714 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:48,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:11:48,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:11:48,714 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:11:48,714 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:48,714 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:48,715 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:48,715 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:11:48,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:48,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:48,715 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:11:48,715 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:48,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:48,717 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:11:48,717 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:11:48,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:11:48,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:11:48,717 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:11:48,717 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:11:48,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:11:48,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:11:48,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:48,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:48,718 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:48,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:48,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:48,718 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:11:48,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:11:48,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:48,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:11:48,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:48,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:11:48,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:11:48,720 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:11:48,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:48,721 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:48,722 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:11:48,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:11:48,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:48,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:11:48,727 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:11:48,727 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:11:48,727 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:11:48,727 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:11:48,727 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:11:48,727 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:11:48,727 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:11:48,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:11:48,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:11:48,727 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:48,727 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:48,727 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:48,728 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-18 10:11:48,727 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:11:48,727 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:11:48,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:11:48,728 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-18 10:11:48,728 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:11:48,728 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:48,728 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:48,727 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:11:48,729 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:11:48,729 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:48,731 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:11:48,731 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:48,731 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:48,731 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:11:48,731 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:48,731 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:48,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:11:48,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:11:48,733 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:11:48,733 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:11:48,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:11:48,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:11:48,795 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:48,796 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:48,855 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:48,886 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-18 10:11:48,886 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:48,886 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:48,887 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689675108592Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1689675108795 (+203 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689675108795Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689675108795Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689675108819 (+24 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689675108844 (+25 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689675108886 (+42 ms) 2023-07-18 10:11:48,890 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-18 10:11:48,891 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 297 msec 2023-07-18 10:11:48,898 DEBUG [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 10:11:48,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-18 10:11:48,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-18 10:11:48,902 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43301] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1689675107926.d76d20d2003fd3fe909413d09bad137e. with WAL disabled. Data may be lost in the event of a crash. 2023-07-18 10:11:48,903 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37417] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1689675107926.30ce7c205ed3f723a7370424f91dd153. with WAL disabled. Data may be lost in the event of a crash. 2023-07-18 10:11:48,907 DEBUG [Listener at jenkins-hbase4.apache.org/34477] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:48,907 DEBUG [Listener at jenkins-hbase4.apache.org/34477] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689675107926.d76d20d2003fd3fe909413d09bad137e. 2023-07-18 10:11:48,907 INFO [Listener at jenkins-hbase4.apache.org/34477] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 10:11:48,919 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-18 10:11:48,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689675108919 (current time:1689675108919). 2023-07-18 10:11:48,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-18 10:11:48,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] zookeeper.ReadOnlyZKClient(139): Connect 0x1e9e97f6 to 127.0.0.1:60990 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 10:11:48,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@57a02a8c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 10:11:48,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 10:11:48,932 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35626, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 10:11:48,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1e9e97f6 to 127.0.0.1:60990 2023-07-18 10:11:48,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 10:11:48,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] zookeeper.ReadOnlyZKClient(139): Connect 0x0c252d8b to 127.0.0.1:60990 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 10:11:48,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@666e2ade, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 10:11:48,941 DEBUG [hconnection-0x30cc98d5-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 10:11:48,944 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35640, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 10:11:48,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 10:11:48,952 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55058, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 10:11:48,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0c252d8b to 127.0.0.1:60990 2023-07-18 10:11:48,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 10:11:48,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-18 10:11:48,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-18 10:11:48,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-18 10:11:48,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-18 10:11:48,958 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-18 10:11:48,960 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689675708960 2023-07-18 10:11:48,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-18 10:11:48,962 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:48,964 DEBUG [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-18 10:11:48,965 DEBUG [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-18 10:11:48,964 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-18 10:11:48,965 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-18 10:11:48,966 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 9 msec 2023-07-18 10:11:48,967 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-18 10:11:48,968 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689675708968 2023-07-18 10:11:49,017 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,017 INFO [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-18 10:11:49,017 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:11:49,019 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-18 10:11:49,019 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-18 10:11:49,019 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,020 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,022 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:11:49,022 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:11:49,022 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:11:49,022 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:11:49,022 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:11:49,022 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:11:49,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:11:49,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:11:49,022 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:11:49,022 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:11:49,023 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:49,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,023 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:49,023 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-18 10:11:49,023 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:11:49,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-18 10:11:49,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,024 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-18 10:11:49,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,024 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-18 10:11:49,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,025 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,025 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-18 10:11:49,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-18 10:11:49,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,026 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-18 10:11:49,026 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,027 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-18 10:11:49,027 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:11:49,027 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,027 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-18 10:11:49,027 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:11:49,030 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,032 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-18 10:11:49,032 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-18 10:11:49,032 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-18 10:11:49,032 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-18 10:11:49,032 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-18 10:11:49,032 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43301,1689675027670' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-18 10:11:49,032 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:11:49,032 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37417,1689675027545' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-18 10:11:49,034 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-18 10:11:49,034 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-18 10:11:49,034 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39709,1689675027617' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-18 10:11:49,035 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:11:49,035 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,035 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:49,035 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:11:49,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:11:49,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:11:49,037 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,037 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,037 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 10:11:49,038 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,038 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:11:49,038 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 10:11:49,038 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 10:11:49,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:11:49,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:49,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:11:49,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:11:49,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:11:49,041 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43301,1689675027670' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-18 10:11:49,041 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7a32b3b3[Count = 1] remaining members to acquire global barrier 2023-07-18 10:11:49,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:49,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:11:49,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:11:49,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:11:49,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:11:49,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:49,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:11:49,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:11:49,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:11:49,044 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37417,1689675027545' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-18 10:11:49,044 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7a32b3b3[Count = 0] remaining members to acquire global barrier 2023-07-18 10:11:49,044 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-18 10:11:49,044 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,047 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,047 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,047 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:11:49,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,047 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,047 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-18 10:11:49,047 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,047 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-18 10:11:49,047 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 10:11:49,047 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 10:11:49,047 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:49,047 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-18 10:11:49,047 DEBUG [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689675107926.30ce7c205ed3f723a7370424f91dd153. 2023-07-18 10:11:49,047 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 10:11:49,047 DEBUG [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689675107926.30ce7c205ed3f723a7370424f91dd153. started... 2023-07-18 10:11:49,047 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 10:11:49,047 DEBUG [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689675107926.d76d20d2003fd3fe909413d09bad137e. 2023-07-18 10:11:49,047 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,048 DEBUG [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689675107926.d76d20d2003fd3fe909413d09bad137e. started... 2023-07-18 10:11:49,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,048 INFO [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 30ce7c205ed3f723a7370424f91dd153 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-18 10:11:49,048 INFO [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] regionserver.HRegion(2745): Flushing d76d20d2003fd3fe909413d09bad137e 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-18 10:11:49,048 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-18 10:11:49,048 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-18 10:11:49,048 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,39709,1689675027617' in zk 2023-07-18 10:11:49,051 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-18 10:11:49,051 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:11:49,051 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-18 10:11:49,065 DEBUG [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 10:11:49,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-18 10:11:49,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-18 10:11:49,066 DEBUG [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-18 10:11:49,102 INFO [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230718834a0839e6d04853b4eae40dbad25ba7 to hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230718834a0839e6d04853b4eae40dbad25ba7 2023-07-18 10:11:49,108 INFO [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230718e0b6a0d646e040799845ff16e0e4042b to hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230718e0b6a0d646e040799845ff16e0e4042b 2023-07-18 10:11:49,121 INFO [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemStateWithMergeRegion/d76d20d2003fd3fe909413d09bad137e/.tmp/cf/5be07002a87648fda3a3cbfd37de580c 2023-07-18 10:11:49,128 DEBUG [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemStateWithMergeRegion/d76d20d2003fd3fe909413d09bad137e/.tmp/cf/5be07002a87648fda3a3cbfd37de580c as hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemStateWithMergeRegion/d76d20d2003fd3fe909413d09bad137e/cf/5be07002a87648fda3a3cbfd37de580c 2023-07-18 10:11:49,136 INFO [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemStateWithMergeRegion/30ce7c205ed3f723a7370424f91dd153/.tmp/cf/9821fc74d2644af296e671412f526121 2023-07-18 10:11:49,136 INFO [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemStateWithMergeRegion/d76d20d2003fd3fe909413d09bad137e/cf/5be07002a87648fda3a3cbfd37de580c, entries=4, sequenceid=6, filesize=5.6 K 2023-07-18 10:11:49,139 INFO [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for d76d20d2003fd3fe909413d09bad137e in 91ms, sequenceid=6, compaction requested=false 2023-07-18 10:11:49,140 DEBUG [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-18 10:11:49,140 DEBUG [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d76d20d2003fd3fe909413d09bad137e: 2023-07-18 10:11:49,141 DEBUG [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689675107926.d76d20d2003fd3fe909413d09bad137e.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,141 DEBUG [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 10:11:49,141 DEBUG [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemStateWithMergeRegion/d76d20d2003fd3fe909413d09bad137e/cf/5be07002a87648fda3a3cbfd37de580c] hfiles 2023-07-18 10:11:49,141 DEBUG [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemStateWithMergeRegion/d76d20d2003fd3fe909413d09bad137e/cf/5be07002a87648fda3a3cbfd37de580c for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,159 DEBUG [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemStateWithMergeRegion/30ce7c205ed3f723a7370424f91dd153/.tmp/cf/9821fc74d2644af296e671412f526121 as hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemStateWithMergeRegion/30ce7c205ed3f723a7370424f91dd153/cf/9821fc74d2644af296e671412f526121 2023-07-18 10:11:49,165 INFO [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemStateWithMergeRegion/30ce7c205ed3f723a7370424f91dd153/cf/9821fc74d2644af296e671412f526121, entries=46, sequenceid=6, filesize=13.3 K 2023-07-18 10:11:49,167 INFO [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 30ce7c205ed3f723a7370424f91dd153 in 119ms, sequenceid=6, compaction requested=false 2023-07-18 10:11:49,169 DEBUG [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 30ce7c205ed3f723a7370424f91dd153: 2023-07-18 10:11:49,170 DEBUG [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689675107926.30ce7c205ed3f723a7370424f91dd153.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,170 DEBUG [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 10:11:49,170 DEBUG [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemStateWithMergeRegion/30ce7c205ed3f723a7370424f91dd153/cf/9821fc74d2644af296e671412f526121] hfiles 2023-07-18 10:11:49,170 DEBUG [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemStateWithMergeRegion/30ce7c205ed3f723a7370424f91dd153/cf/9821fc74d2644af296e671412f526121 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,195 DEBUG [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689675107926.d76d20d2003fd3fe909413d09bad137e. completed. 2023-07-18 10:11:49,195 DEBUG [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689675107926.d76d20d2003fd3fe909413d09bad137e. 2023-07-18 10:11:49,195 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 10:11:49,195 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 10:11:49,195 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:11:49,195 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-18 10:11:49,195 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,43301,1689675027670' in zk 2023-07-18 10:11:49,212 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:11:49,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:11:49,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:11:49,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:11:49,212 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-18 10:11:49,212 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:11:49,212 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-18 10:11:49,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:11:49,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:11:49,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:49,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:11:49,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:11:49,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:11:49,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:11:49,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:11:49,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,43301,1689675027670': 2023-07-18 10:11:49,228 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43301,1689675027670' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-18 10:11:49,247 DEBUG [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689675107926.30ce7c205ed3f723a7370424f91dd153. completed. 2023-07-18 10:11:49,247 DEBUG [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689675107926.30ce7c205ed3f723a7370424f91dd153. 2023-07-18 10:11:49,248 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 10:11:49,248 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 10:11:49,248 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:49,248 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-18 10:11:49,248 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,37417,1689675027545' in zk 2023-07-18 10:11:49,250 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:49,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:49,250 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-18 10:11:49,250 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:11:49,250 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-18 10:11:49,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:11:49,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:11:49,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:11:49,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:11:49,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:49,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:11:49,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:11:49,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:11:49,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:11:49,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:49,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:11:49,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,37417,1689675027545': 2023-07-18 10:11:49,255 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37417,1689675027545' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-18 10:11:49,255 INFO [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-18 10:11:49,256 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-18 10:11:49,256 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-18 10:11:49,256 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,256 INFO [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-18 10:11:49,261 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,261 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,262 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,262 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:11:49,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,262 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:11:49,261 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:11:49,261 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:11:49,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:11:49,262 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:49,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:11:49,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:11:49,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:11:49,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:11:49,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:11:49,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:11:49,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,263 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:11:49,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:11:49,264 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:11:49,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:11:49,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:49,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:11:49,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:11:49,266 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:11:49,266 DEBUG [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 10:11:49,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:11:49,267 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:49,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-18 10:11:49,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-18 10:11:49,268 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:11:49,268 DEBUG [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-18 10:11:49,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:11:49,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:49,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:11:49,272 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:11:49,273 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:11:49,273 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:11:49,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:11:49,273 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:11:49,273 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:11:49,275 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,275 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:11:49,275 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:49,275 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,275 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:11:49,275 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,275 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:49,275 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:11:49,275 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,275 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,275 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:11:49,275 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:11:49,275 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:11:49,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:11:49,275 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:11:49,273 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,275 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:11:49,276 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,276 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:11:49,275 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:11:49,276 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:11:49,276 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-18 10:11:49,276 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:11:49,276 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:11:49,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:11:49,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:11:49,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:11:49,277 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230718e0b6a0d646e040799845ff16e0e4042b, hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230718834a0839e6d04853b4eae40dbad25ba7] mob files 2023-07-18 10:11:49,277 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230718e0b6a0d646e040799845ff16e0e4042b 2023-07-18 10:11:49,277 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230718834a0839e6d04853b4eae40dbad25ba7 2023-07-18 10:11:49,326 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,327 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,372 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,407 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-18 10:11:49,407 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,407 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:11:49,407 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689675108962Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1689675109326 (+364 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689675109326Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1689675109326Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1689675109338 (+12 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689675109359 (+21 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689675109407 (+48 ms) 2023-07-18 10:11:49,411 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-18 10:11:49,412 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 448 msec 2023-07-18 10:11:49,568 DEBUG [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 10:11:49,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-18 10:11:49,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-18 10:11:49,612 DEBUG [Listener at jenkins-hbase4.apache.org/34477] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-18 10:11:49,626 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57086, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-18 10:11:49,629 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37417] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-18 10:11:49,630 DEBUG [Listener at jenkins-hbase4.apache.org/34477] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-18 10:11:49,643 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35650, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-18 10:11:49,643 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39709] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-18 10:11:49,644 DEBUG [Listener at jenkins-hbase4.apache.org/34477] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-18 10:11:49,649 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55070, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-18 10:11:49,649 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43301] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-18 10:11:49,657 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-18 10:11:49,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:49,662 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-18 10:11:49,662 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-18 10:11:49,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-18 10:11:49,666 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-18 10:11:49,669 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/36cc259f07d70cf0cdea08a4181bf042 2023-07-18 10:11:49,669 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d9ffc3b9364d395b01e7a198dc00fbd5 2023-07-18 10:11:49,669 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/36cc259f07d70cf0cdea08a4181bf042 empty. 2023-07-18 10:11:49,670 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d9ffc3b9364d395b01e7a198dc00fbd5 empty. 2023-07-18 10:11:49,670 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/36cc259f07d70cf0cdea08a4181bf042 2023-07-18 10:11:49,670 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d9ffc3b9364d395b01e7a198dc00fbd5 2023-07-18 10:11:49,670 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-18 10:11:49,702 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-18 10:11:49,707 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 36cc259f07d70cf0cdea08a4181bf042, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689675109657.36cc259f07d70cf0cdea08a4181bf042.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp 2023-07-18 10:11:49,708 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => d9ffc3b9364d395b01e7a198dc00fbd5, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689675109657.d9ffc3b9364d395b01e7a198dc00fbd5.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp 2023-07-18 10:11:49,748 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689675109657.36cc259f07d70cf0cdea08a4181bf042.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 10:11:49,748 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 36cc259f07d70cf0cdea08a4181bf042, disabling compactions & flushes 2023-07-18 10:11:49,748 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689675109657.36cc259f07d70cf0cdea08a4181bf042. 2023-07-18 10:11:49,748 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689675109657.36cc259f07d70cf0cdea08a4181bf042. 2023-07-18 10:11:49,748 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689675109657.36cc259f07d70cf0cdea08a4181bf042. after waiting 0 ms 2023-07-18 10:11:49,749 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689675109657.36cc259f07d70cf0cdea08a4181bf042. 2023-07-18 10:11:49,749 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689675109657.36cc259f07d70cf0cdea08a4181bf042. 2023-07-18 10:11:49,749 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 36cc259f07d70cf0cdea08a4181bf042: 2023-07-18 10:11:49,754 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689675109657.d9ffc3b9364d395b01e7a198dc00fbd5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 10:11:49,754 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing d9ffc3b9364d395b01e7a198dc00fbd5, disabling compactions & flushes 2023-07-18 10:11:49,754 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689675109657.d9ffc3b9364d395b01e7a198dc00fbd5. 2023-07-18 10:11:49,754 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689675109657.d9ffc3b9364d395b01e7a198dc00fbd5. 2023-07-18 10:11:49,754 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689675109657.d9ffc3b9364d395b01e7a198dc00fbd5. after waiting 0 ms 2023-07-18 10:11:49,754 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689675109657.d9ffc3b9364d395b01e7a198dc00fbd5. 2023-07-18 10:11:49,754 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689675109657.d9ffc3b9364d395b01e7a198dc00fbd5. 2023-07-18 10:11:49,754 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for d9ffc3b9364d395b01e7a198dc00fbd5: 2023-07-18 10:11:49,757 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-18 10:11:49,758 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689675109657.36cc259f07d70cf0cdea08a4181bf042.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689675109758"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689675109758"}]},"ts":"1689675109758"} 2023-07-18 10:11:49,758 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689675109657.d9ffc3b9364d395b01e7a198dc00fbd5.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689675109758"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689675109758"}]},"ts":"1689675109758"} 2023-07-18 10:11:49,761 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-18 10:11:49,762 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-18 10:11:49,762 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689675109762"}]},"ts":"1689675109762"} 2023-07-18 10:11:49,764 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-18 10:11:49,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-18 10:11:49,769 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 10:11:49,770 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 10:11:49,770 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 10:11:49,770 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-18 10:11:49,770 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 10:11:49,771 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=36cc259f07d70cf0cdea08a4181bf042, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d9ffc3b9364d395b01e7a198dc00fbd5, ASSIGN}] 2023-07-18 10:11:49,774 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d9ffc3b9364d395b01e7a198dc00fbd5, ASSIGN 2023-07-18 10:11:49,774 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=36cc259f07d70cf0cdea08a4181bf042, ASSIGN 2023-07-18 10:11:49,775 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=36cc259f07d70cf0cdea08a4181bf042, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37417,1689675027545; forceNewPlan=false, retain=false 2023-07-18 10:11:49,775 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d9ffc3b9364d395b01e7a198dc00fbd5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39709,1689675027617; forceNewPlan=false, retain=false 2023-07-18 10:11:49,925 INFO [jenkins-hbase4:38235] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-18 10:11:49,929 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=d9ffc3b9364d395b01e7a198dc00fbd5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:11:49,929 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=36cc259f07d70cf0cdea08a4181bf042, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:49,929 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689675109657.d9ffc3b9364d395b01e7a198dc00fbd5.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689675109929"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689675109929"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689675109929"}]},"ts":"1689675109929"} 2023-07-18 10:11:49,929 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689675109657.36cc259f07d70cf0cdea08a4181bf042.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689675109929"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689675109929"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689675109929"}]},"ts":"1689675109929"} 2023-07-18 10:11:49,931 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=68, state=RUNNABLE; OpenRegionProcedure d9ffc3b9364d395b01e7a198dc00fbd5, server=jenkins-hbase4.apache.org,39709,1689675027617}] 2023-07-18 10:11:49,932 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=67, state=RUNNABLE; OpenRegionProcedure 36cc259f07d70cf0cdea08a4181bf042, server=jenkins-hbase4.apache.org,37417,1689675027545}] 2023-07-18 10:11:49,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-18 10:11:50,087 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1689675109657.d9ffc3b9364d395b01e7a198dc00fbd5. 2023-07-18 10:11:50,087 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d9ffc3b9364d395b01e7a198dc00fbd5, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689675109657.d9ffc3b9364d395b01e7a198dc00fbd5.', STARTKEY => '2', ENDKEY => ''} 2023-07-18 10:11:50,088 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689675109657.36cc259f07d70cf0cdea08a4181bf042. 2023-07-18 10:11:50,088 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 36cc259f07d70cf0cdea08a4181bf042, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689675109657.36cc259f07d70cf0cdea08a4181bf042.', STARTKEY => '', ENDKEY => '2'} 2023-07-18 10:11:50,088 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1689675109657.d9ffc3b9364d395b01e7a198dc00fbd5. service=AccessControlService 2023-07-18 10:11:50,088 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689675109657.36cc259f07d70cf0cdea08a4181bf042. service=AccessControlService 2023-07-18 10:11:50,088 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 10:11:50,088 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 10:11:50,089 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 d9ffc3b9364d395b01e7a198dc00fbd5 2023-07-18 10:11:50,089 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 36cc259f07d70cf0cdea08a4181bf042 2023-07-18 10:11:50,089 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689675109657.d9ffc3b9364d395b01e7a198dc00fbd5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 10:11:50,089 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689675109657.36cc259f07d70cf0cdea08a4181bf042.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 10:11:50,089 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d9ffc3b9364d395b01e7a198dc00fbd5 2023-07-18 10:11:50,089 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 36cc259f07d70cf0cdea08a4181bf042 2023-07-18 10:11:50,089 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d9ffc3b9364d395b01e7a198dc00fbd5 2023-07-18 10:11:50,089 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 36cc259f07d70cf0cdea08a4181bf042 2023-07-18 10:11:50,092 INFO [StoreOpener-36cc259f07d70cf0cdea08a4181bf042-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 36cc259f07d70cf0cdea08a4181bf042 2023-07-18 10:11:50,094 DEBUG [StoreOpener-36cc259f07d70cf0cdea08a4181bf042-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/36cc259f07d70cf0cdea08a4181bf042/cf 2023-07-18 10:11:50,094 DEBUG [StoreOpener-36cc259f07d70cf0cdea08a4181bf042-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/36cc259f07d70cf0cdea08a4181bf042/cf 2023-07-18 10:11:50,095 INFO [StoreOpener-d9ffc3b9364d395b01e7a198dc00fbd5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region d9ffc3b9364d395b01e7a198dc00fbd5 2023-07-18 10:11:50,095 INFO [StoreOpener-36cc259f07d70cf0cdea08a4181bf042-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 36cc259f07d70cf0cdea08a4181bf042 columnFamilyName cf 2023-07-18 10:11:50,096 INFO [StoreOpener-36cc259f07d70cf0cdea08a4181bf042-1] regionserver.HStore(310): Store=36cc259f07d70cf0cdea08a4181bf042/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 10:11:50,096 DEBUG [StoreOpener-d9ffc3b9364d395b01e7a198dc00fbd5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d9ffc3b9364d395b01e7a198dc00fbd5/cf 2023-07-18 10:11:50,097 DEBUG [StoreOpener-d9ffc3b9364d395b01e7a198dc00fbd5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d9ffc3b9364d395b01e7a198dc00fbd5/cf 2023-07-18 10:11:50,097 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/36cc259f07d70cf0cdea08a4181bf042 2023-07-18 10:11:50,097 INFO [StoreOpener-d9ffc3b9364d395b01e7a198dc00fbd5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d9ffc3b9364d395b01e7a198dc00fbd5 columnFamilyName cf 2023-07-18 10:11:50,097 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/36cc259f07d70cf0cdea08a4181bf042 2023-07-18 10:11:50,098 INFO [StoreOpener-d9ffc3b9364d395b01e7a198dc00fbd5-1] regionserver.HStore(310): Store=d9ffc3b9364d395b01e7a198dc00fbd5/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 10:11:50,098 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d9ffc3b9364d395b01e7a198dc00fbd5 2023-07-18 10:11:50,099 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d9ffc3b9364d395b01e7a198dc00fbd5 2023-07-18 10:11:50,101 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 36cc259f07d70cf0cdea08a4181bf042 2023-07-18 10:11:50,103 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d9ffc3b9364d395b01e7a198dc00fbd5 2023-07-18 10:11:50,107 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/36cc259f07d70cf0cdea08a4181bf042/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 10:11:50,107 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 36cc259f07d70cf0cdea08a4181bf042; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64887577, jitterRate=-0.03309975564479828}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 10:11:50,107 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 36cc259f07d70cf0cdea08a4181bf042: 2023-07-18 10:11:50,108 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689675109657.36cc259f07d70cf0cdea08a4181bf042., pid=70, masterSystemTime=1689675110084 2023-07-18 10:11:50,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689675109657.36cc259f07d70cf0cdea08a4181bf042. 2023-07-18 10:11:50,110 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689675109657.36cc259f07d70cf0cdea08a4181bf042. 2023-07-18 10:11:50,110 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=36cc259f07d70cf0cdea08a4181bf042, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:50,111 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689675109657.36cc259f07d70cf0cdea08a4181bf042.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689675110110"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689675110110"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689675110110"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689675110110"}]},"ts":"1689675110110"} 2023-07-18 10:11:50,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d9ffc3b9364d395b01e7a198dc00fbd5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 10:11:50,112 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d9ffc3b9364d395b01e7a198dc00fbd5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74387208, jitterRate=0.10845577716827393}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 10:11:50,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d9ffc3b9364d395b01e7a198dc00fbd5: 2023-07-18 10:11:50,112 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689675109657.d9ffc3b9364d395b01e7a198dc00fbd5., pid=69, masterSystemTime=1689675110083 2023-07-18 10:11:50,114 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689675109657.d9ffc3b9364d395b01e7a198dc00fbd5. 2023-07-18 10:11:50,114 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1689675109657.d9ffc3b9364d395b01e7a198dc00fbd5. 2023-07-18 10:11:50,116 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=67 2023-07-18 10:11:50,116 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=d9ffc3b9364d395b01e7a198dc00fbd5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:11:50,116 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=67, state=SUCCESS; OpenRegionProcedure 36cc259f07d70cf0cdea08a4181bf042, server=jenkins-hbase4.apache.org,37417,1689675027545 in 180 msec 2023-07-18 10:11:50,116 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689675109657.d9ffc3b9364d395b01e7a198dc00fbd5.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689675110116"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689675110116"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689675110116"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689675110116"}]},"ts":"1689675110116"} 2023-07-18 10:11:50,117 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=36cc259f07d70cf0cdea08a4181bf042, ASSIGN in 345 msec 2023-07-18 10:11:50,120 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=68 2023-07-18 10:11:50,120 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=68, state=SUCCESS; OpenRegionProcedure d9ffc3b9364d395b01e7a198dc00fbd5, server=jenkins-hbase4.apache.org,39709,1689675027617 in 187 msec 2023-07-18 10:11:50,123 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=68, resume processing ppid=66 2023-07-18 10:11:50,123 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d9ffc3b9364d395b01e7a198dc00fbd5, ASSIGN in 349 msec 2023-07-18 10:11:50,125 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-18 10:11:50,125 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689675110125"}]},"ts":"1689675110125"} 2023-07-18 10:11:50,127 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-18 10:11:50,130 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-18 10:11:50,130 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-18 10:11:50,132 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43301] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-18 10:11:50,136 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:11:50,136 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:11:50,136 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:11:50,139 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:11:50,140 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-18 10:11:50,141 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-18 10:11:50,141 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-18 10:11:50,141 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-18 10:11:50,141 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-18 10:11:50,141 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-18 10:11:50,141 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-18 10:11:50,141 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-18 10:11:50,143 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 483 msec 2023-07-18 10:11:50,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-18 10:11:50,268 INFO [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-18 10:11:50,299 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions 36cc259f07d70cf0cdea08a4181bf042, d9ffc3b9364d395b01e7a198dc00fbd5 2023-07-18 10:11:50,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[36cc259f07d70cf0cdea08a4181bf042, d9ffc3b9364d395b01e7a198dc00fbd5], force=true 2023-07-18 10:11:50,310 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[36cc259f07d70cf0cdea08a4181bf042, d9ffc3b9364d395b01e7a198dc00fbd5], force=true 2023-07-18 10:11:50,310 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[36cc259f07d70cf0cdea08a4181bf042, d9ffc3b9364d395b01e7a198dc00fbd5], force=true 2023-07-18 10:11:50,310 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[36cc259f07d70cf0cdea08a4181bf042, d9ffc3b9364d395b01e7a198dc00fbd5], force=true 2023-07-18 10:11:50,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-18 10:11:50,335 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=36cc259f07d70cf0cdea08a4181bf042, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d9ffc3b9364d395b01e7a198dc00fbd5, UNASSIGN}] 2023-07-18 10:11:50,337 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=36cc259f07d70cf0cdea08a4181bf042, UNASSIGN 2023-07-18 10:11:50,337 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d9ffc3b9364d395b01e7a198dc00fbd5, UNASSIGN 2023-07-18 10:11:50,338 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=36cc259f07d70cf0cdea08a4181bf042, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:50,338 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=d9ffc3b9364d395b01e7a198dc00fbd5, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:11:50,338 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689675109657.36cc259f07d70cf0cdea08a4181bf042.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689675110338"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689675110338"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689675110338"}]},"ts":"1689675110338"} 2023-07-18 10:11:50,338 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689675109657.d9ffc3b9364d395b01e7a198dc00fbd5.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689675110338"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689675110338"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689675110338"}]},"ts":"1689675110338"} 2023-07-18 10:11:50,340 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure 36cc259f07d70cf0cdea08a4181bf042, server=jenkins-hbase4.apache.org,37417,1689675027545}] 2023-07-18 10:11:50,340 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure d9ffc3b9364d395b01e7a198dc00fbd5, server=jenkins-hbase4.apache.org,39709,1689675027617}] 2023-07-18 10:11:50,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-18 10:11:50,492 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 36cc259f07d70cf0cdea08a4181bf042 2023-07-18 10:11:50,494 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 36cc259f07d70cf0cdea08a4181bf042, disabling compactions & flushes 2023-07-18 10:11:50,494 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689675109657.36cc259f07d70cf0cdea08a4181bf042. 2023-07-18 10:11:50,494 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689675109657.36cc259f07d70cf0cdea08a4181bf042. 2023-07-18 10:11:50,494 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689675109657.36cc259f07d70cf0cdea08a4181bf042. after waiting 0 ms 2023-07-18 10:11:50,494 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689675109657.36cc259f07d70cf0cdea08a4181bf042. 2023-07-18 10:11:50,495 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 36cc259f07d70cf0cdea08a4181bf042 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-18 10:11:50,495 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close d9ffc3b9364d395b01e7a198dc00fbd5 2023-07-18 10:11:50,496 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d9ffc3b9364d395b01e7a198dc00fbd5, disabling compactions & flushes 2023-07-18 10:11:50,496 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689675109657.d9ffc3b9364d395b01e7a198dc00fbd5. 2023-07-18 10:11:50,496 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689675109657.d9ffc3b9364d395b01e7a198dc00fbd5. 2023-07-18 10:11:50,496 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689675109657.d9ffc3b9364d395b01e7a198dc00fbd5. after waiting 0 ms 2023-07-18 10:11:50,496 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689675109657.d9ffc3b9364d395b01e7a198dc00fbd5. 2023-07-18 10:11:50,496 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing d9ffc3b9364d395b01e7a198dc00fbd5 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-18 10:11:50,519 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/36cc259f07d70cf0cdea08a4181bf042/.tmp/cf/781d15caa88e4aa1bb4bf305aa22cae6 2023-07-18 10:11:50,528 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d9ffc3b9364d395b01e7a198dc00fbd5/.tmp/cf/4006a31ea17d4b698395789cf8cec6a9 2023-07-18 10:11:50,532 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/36cc259f07d70cf0cdea08a4181bf042/.tmp/cf/781d15caa88e4aa1bb4bf305aa22cae6 as hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/36cc259f07d70cf0cdea08a4181bf042/cf/781d15caa88e4aa1bb4bf305aa22cae6 2023-07-18 10:11:50,540 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d9ffc3b9364d395b01e7a198dc00fbd5/.tmp/cf/4006a31ea17d4b698395789cf8cec6a9 as hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d9ffc3b9364d395b01e7a198dc00fbd5/cf/4006a31ea17d4b698395789cf8cec6a9 2023-07-18 10:11:50,546 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/36cc259f07d70cf0cdea08a4181bf042/cf/781d15caa88e4aa1bb4bf305aa22cae6, entries=1, sequenceid=5, filesize=4.7 K 2023-07-18 10:11:50,547 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 36cc259f07d70cf0cdea08a4181bf042 in 53ms, sequenceid=5, compaction requested=false 2023-07-18 10:11:50,547 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-18 10:11:50,548 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d9ffc3b9364d395b01e7a198dc00fbd5/cf/4006a31ea17d4b698395789cf8cec6a9, entries=1, sequenceid=5, filesize=4.7 K 2023-07-18 10:11:50,548 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for d9ffc3b9364d395b01e7a198dc00fbd5 in 52ms, sequenceid=5, compaction requested=false 2023-07-18 10:11:50,564 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/36cc259f07d70cf0cdea08a4181bf042/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-18 10:11:50,569 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 10:11:50,569 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d9ffc3b9364d395b01e7a198dc00fbd5/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-18 10:11:50,569 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689675109657.36cc259f07d70cf0cdea08a4181bf042. 2023-07-18 10:11:50,569 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 36cc259f07d70cf0cdea08a4181bf042: 2023-07-18 10:11:50,570 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 10:11:50,570 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689675109657.d9ffc3b9364d395b01e7a198dc00fbd5. 2023-07-18 10:11:50,570 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d9ffc3b9364d395b01e7a198dc00fbd5: 2023-07-18 10:11:50,571 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 36cc259f07d70cf0cdea08a4181bf042 2023-07-18 10:11:50,575 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=36cc259f07d70cf0cdea08a4181bf042, regionState=CLOSED 2023-07-18 10:11:50,575 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689675109657.36cc259f07d70cf0cdea08a4181bf042.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689675110575"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689675110575"}]},"ts":"1689675110575"} 2023-07-18 10:11:50,576 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed d9ffc3b9364d395b01e7a198dc00fbd5 2023-07-18 10:11:50,576 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=d9ffc3b9364d395b01e7a198dc00fbd5, regionState=CLOSED 2023-07-18 10:11:50,576 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689675109657.d9ffc3b9364d395b01e7a198dc00fbd5.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689675110576"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689675110576"}]},"ts":"1689675110576"} 2023-07-18 10:11:50,580 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=72 2023-07-18 10:11:50,580 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure 36cc259f07d70cf0cdea08a4181bf042, server=jenkins-hbase4.apache.org,37417,1689675027545 in 237 msec 2023-07-18 10:11:50,582 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=73 2023-07-18 10:11:50,583 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure d9ffc3b9364d395b01e7a198dc00fbd5, server=jenkins-hbase4.apache.org,39709,1689675027617 in 238 msec 2023-07-18 10:11:50,584 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=36cc259f07d70cf0cdea08a4181bf042, UNASSIGN in 248 msec 2023-07-18 10:11:50,585 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=73, resume processing ppid=71 2023-07-18 10:11:50,586 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d9ffc3b9364d395b01e7a198dc00fbd5, UNASSIGN in 248 msec 2023-07-18 10:11:50,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-18 10:11:50,693 DEBUG [PEWorker-3] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/878086fd4b9009ea71c35b6ebfbf01b0/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-18 10:11:50,695 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689675109657.36cc259f07d70cf0cdea08a4181bf042.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-18 10:11:50,695 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689675109657.d9ffc3b9364d395b01e7a198dc00fbd5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-18 10:11:50,695 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689675109658.878086fd4b9009ea71c35b6ebfbf01b0.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-18 10:11:50,761 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=878086fd4b9009ea71c35b6ebfbf01b0, ASSIGN}] 2023-07-18 10:11:50,766 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=878086fd4b9009ea71c35b6ebfbf01b0, ASSIGN 2023-07-18 10:11:50,767 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=878086fd4b9009ea71c35b6ebfbf01b0, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,37417,1689675027545; forceNewPlan=false, retain=false 2023-07-18 10:11:50,917 INFO [jenkins-hbase4:38235] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-18 10:11:50,919 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=878086fd4b9009ea71c35b6ebfbf01b0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:50,919 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689675109658.878086fd4b9009ea71c35b6ebfbf01b0.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689675110919"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689675110919"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689675110919"}]},"ts":"1689675110919"} 2023-07-18 10:11:50,921 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 878086fd4b9009ea71c35b6ebfbf01b0, server=jenkins-hbase4.apache.org,37417,1689675027545}] 2023-07-18 10:11:50,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-18 10:11:51,077 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689675109658.878086fd4b9009ea71c35b6ebfbf01b0. 2023-07-18 10:11:51,077 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 878086fd4b9009ea71c35b6ebfbf01b0, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689675109658.878086fd4b9009ea71c35b6ebfbf01b0.', STARTKEY => '', ENDKEY => ''} 2023-07-18 10:11:51,078 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689675109658.878086fd4b9009ea71c35b6ebfbf01b0. service=AccessControlService 2023-07-18 10:11:51,078 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 10:11:51,078 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 878086fd4b9009ea71c35b6ebfbf01b0 2023-07-18 10:11:51,078 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689675109658.878086fd4b9009ea71c35b6ebfbf01b0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 10:11:51,078 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 878086fd4b9009ea71c35b6ebfbf01b0 2023-07-18 10:11:51,078 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 878086fd4b9009ea71c35b6ebfbf01b0 2023-07-18 10:11:51,079 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/878086fd4b9009ea71c35b6ebfbf01b0/.regioninfo 2023-07-18 10:11:51,101 INFO [StoreOpener-878086fd4b9009ea71c35b6ebfbf01b0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 878086fd4b9009ea71c35b6ebfbf01b0 2023-07-18 10:11:51,102 DEBUG [StoreOpener-878086fd4b9009ea71c35b6ebfbf01b0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/878086fd4b9009ea71c35b6ebfbf01b0/cf 2023-07-18 10:11:51,102 DEBUG [StoreOpener-878086fd4b9009ea71c35b6ebfbf01b0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/878086fd4b9009ea71c35b6ebfbf01b0/cf 2023-07-18 10:11:51,102 INFO [StoreOpener-878086fd4b9009ea71c35b6ebfbf01b0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 878086fd4b9009ea71c35b6ebfbf01b0 columnFamilyName cf 2023-07-18 10:11:51,142 DEBUG [StoreOpener-878086fd4b9009ea71c35b6ebfbf01b0-1] regionserver.HStore(539): loaded hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/878086fd4b9009ea71c35b6ebfbf01b0/cf/4006a31ea17d4b698395789cf8cec6a9.d9ffc3b9364d395b01e7a198dc00fbd5->hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d9ffc3b9364d395b01e7a198dc00fbd5/cf/4006a31ea17d4b698395789cf8cec6a9-top 2023-07-18 10:11:51,148 DEBUG [StoreOpener-878086fd4b9009ea71c35b6ebfbf01b0-1] regionserver.HStore(539): loaded hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/878086fd4b9009ea71c35b6ebfbf01b0/cf/781d15caa88e4aa1bb4bf305aa22cae6.36cc259f07d70cf0cdea08a4181bf042->hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/36cc259f07d70cf0cdea08a4181bf042/cf/781d15caa88e4aa1bb4bf305aa22cae6-top 2023-07-18 10:11:51,149 INFO [StoreOpener-878086fd4b9009ea71c35b6ebfbf01b0-1] regionserver.HStore(310): Store=878086fd4b9009ea71c35b6ebfbf01b0/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 10:11:51,150 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/878086fd4b9009ea71c35b6ebfbf01b0 2023-07-18 10:11:51,151 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/878086fd4b9009ea71c35b6ebfbf01b0 2023-07-18 10:11:51,155 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 878086fd4b9009ea71c35b6ebfbf01b0 2023-07-18 10:11:51,155 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 878086fd4b9009ea71c35b6ebfbf01b0; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69978334, jitterRate=0.042758435010910034}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 10:11:51,156 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 878086fd4b9009ea71c35b6ebfbf01b0: 2023-07-18 10:11:51,156 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689675109658.878086fd4b9009ea71c35b6ebfbf01b0., pid=77, masterSystemTime=1689675111073 2023-07-18 10:11:51,157 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1689675109658.878086fd4b9009ea71c35b6ebfbf01b0.,because compaction is disabled. 2023-07-18 10:11:51,158 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689675109658.878086fd4b9009ea71c35b6ebfbf01b0. 2023-07-18 10:11:51,158 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689675109658.878086fd4b9009ea71c35b6ebfbf01b0. 2023-07-18 10:11:51,159 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=878086fd4b9009ea71c35b6ebfbf01b0, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:51,159 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689675109658.878086fd4b9009ea71c35b6ebfbf01b0.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689675111159"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689675111159"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689675111159"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689675111159"}]},"ts":"1689675111159"} 2023-07-18 10:11:51,162 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-18 10:11:51,163 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 878086fd4b9009ea71c35b6ebfbf01b0, server=jenkins-hbase4.apache.org,37417,1689675027545 in 240 msec 2023-07-18 10:11:51,164 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-18 10:11:51,164 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=878086fd4b9009ea71c35b6ebfbf01b0, ASSIGN in 402 msec 2023-07-18 10:11:51,166 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[36cc259f07d70cf0cdea08a4181bf042, d9ffc3b9364d395b01e7a198dc00fbd5], force=true in 862 msec 2023-07-18 10:11:51,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-18 10:11:51,424 INFO [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-18 10:11:51,425 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-18 10:11:51,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689675111425 (current time:1689675111425). 2023-07-18 10:11:51,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-18 10:11:51,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] zookeeper.ReadOnlyZKClient(139): Connect 0x1dc9b6ab to 127.0.0.1:60990 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 10:11:51,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@42e43821, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 10:11:51,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 10:11:51,452 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51006, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 10:11:51,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1dc9b6ab to 127.0.0.1:60990 2023-07-18 10:11:51,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 10:11:51,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] zookeeper.ReadOnlyZKClient(139): Connect 0x72903789 to 127.0.0.1:60990 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 10:11:51,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@22bcab9e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 10:11:51,464 DEBUG [hconnection-0x41fabad8-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 10:11:51,467 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51020, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 10:11:51,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 10:11:51,475 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33152, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 10:11:51,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x72903789 to 127.0.0.1:60990 2023-07-18 10:11:51,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 10:11:51,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-18 10:11:51,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-18 10:11:51,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-18 10:11:51,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-18 10:11:51,481 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-18 10:11:51,482 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1689675711482 2023-07-18 10:11:51,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-18 10:11:51,482 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:51,486 DEBUG [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-18 10:11:51,486 DEBUG [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-18 10:11:51,486 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-18 10:11:51,488 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-18 10:11:51,490 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 9 msec 2023-07-18 10:11:51,491 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-18 10:11:51,491 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1689675711491 2023-07-18 10:11:51,502 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:51,502 INFO [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-18 10:11:51,502 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:11:51,503 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-18 10:11:51,503 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-18 10:11:51,503 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:51,503 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:51,505 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:11:51,505 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:51,505 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:11:51,505 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:11:51,505 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:11:51,505 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:11:51,505 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:11:51,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:11:51,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:11:51,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:11:51,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:51,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:51,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:51,507 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:51,507 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-18 10:11:51,507 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:51,507 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:51,507 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:51,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-18 10:11:51,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-18 10:11:51,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:51,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-18 10:11:51,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:51,508 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-18 10:11:51,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:51,508 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-18 10:11:51,508 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-18 10:11:51,508 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:51,508 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-18 10:11:51,508 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:11:51,509 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:51,509 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-18 10:11:51,509 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:11:51,511 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-18 10:11:51,511 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-18 10:11:51,511 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-18 10:11:51,511 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-18 10:11:51,511 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37417,1689675027545' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-18 10:11:51,511 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:51,511 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43301,1689675027670' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-18 10:11:51,513 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:51,513 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:51,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:51,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:11:51,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:11:51,514 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:51,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:11:51,514 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:51,514 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 10:11:51,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:11:51,515 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:51,515 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 10:11:51,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:51,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:51,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:11:51,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:11:51,516 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37417,1689675027545' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-18 10:11:51,516 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@766695b8[Count = 0] remaining members to acquire global barrier 2023-07-18 10:11:51,516 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-18 10:11:51,516 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:51,518 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:51,518 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:51,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:51,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:51,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:51,518 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-18 10:11:51,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:51,519 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:11:51,518 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-18 10:11:51,520 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-18 10:11:51,519 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:51,520 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-18 10:11:51,519 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-18 10:11:51,520 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-18 10:11:51,520 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-18 10:11:51,520 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39709,1689675027617' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-18 10:11:51,520 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,43301,1689675027670' in zk 2023-07-18 10:11:51,520 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 10:11:51,520 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 10:11:51,521 DEBUG [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689675109658.878086fd4b9009ea71c35b6ebfbf01b0. 2023-07-18 10:11:51,521 DEBUG [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689675109658.878086fd4b9009ea71c35b6ebfbf01b0. started... 2023-07-18 10:11:51,522 DEBUG [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 878086fd4b9009ea71c35b6ebfbf01b0: 2023-07-18 10:11:51,522 DEBUG [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689675109658.878086fd4b9009ea71c35b6ebfbf01b0.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:51,522 DEBUG [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 10:11:51,522 DEBUG [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/878086fd4b9009ea71c35b6ebfbf01b0/cf/4006a31ea17d4b698395789cf8cec6a9.d9ffc3b9364d395b01e7a198dc00fbd5->hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d9ffc3b9364d395b01e7a198dc00fbd5/cf/4006a31ea17d4b698395789cf8cec6a9-top, hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/878086fd4b9009ea71c35b6ebfbf01b0/cf/781d15caa88e4aa1bb4bf305aa22cae6.36cc259f07d70cf0cdea08a4181bf042->hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/36cc259f07d70cf0cdea08a4181bf042/cf/781d15caa88e4aa1bb4bf305aa22cae6-top] hfiles 2023-07-18 10:11:51,522 DEBUG [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/878086fd4b9009ea71c35b6ebfbf01b0/cf/4006a31ea17d4b698395789cf8cec6a9.d9ffc3b9364d395b01e7a198dc00fbd5 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:51,523 DEBUG [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/878086fd4b9009ea71c35b6ebfbf01b0/cf/781d15caa88e4aa1bb4bf305aa22cae6.36cc259f07d70cf0cdea08a4181bf042 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:51,527 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-18 10:11:51,528 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:11:51,528 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-18 10:11:51,529 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:51,530 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] zookeeper.ZKUtil(162): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:51,530 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:51,530 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 10:11:51,530 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-18 10:11:51,530 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-18 10:11:51,530 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,39709,1689675027617' in zk 2023-07-18 10:11:51,531 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-18 10:11:51,531 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:11:51,531 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-18 10:11:51,541 DEBUG [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689675109658.878086fd4b9009ea71c35b6ebfbf01b0. completed. 2023-07-18 10:11:51,541 DEBUG [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689675109658.878086fd4b9009ea71c35b6ebfbf01b0. 2023-07-18 10:11:51,541 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 10:11:51,541 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 10:11:51,541 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:51,541 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-18 10:11:51,541 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,37417,1689675027545' in zk 2023-07-18 10:11:51,549 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-18 10:11:51,549 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:51,549 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:11:51,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:51,549 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-18 10:11:51,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:11:51,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:11:51,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:11:51,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:11:51,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:51,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:51,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:11:51,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:11:51,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:11:51,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:51,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:11:51,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:51,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:11:51,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,37417,1689675027545': 2023-07-18 10:11:51,555 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37417,1689675027545' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-18 10:11:51,555 INFO [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-18 10:11:51,555 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-18 10:11:51,555 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-18 10:11:51,555 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:51,555 INFO [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-18 10:11:51,558 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:51,558 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:51,558 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:51,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:51,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:51,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:11:51,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:11:51,559 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:51,559 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:11:51,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:51,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:51,558 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:11:51,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:51,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:51,559 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:11:51,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:11:51,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:51,560 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:11:51,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:51,560 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:51,560 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:11:51,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:11:51,560 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:11:51,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:11:51,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:11:51,560 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:11:51,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:51,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:11:51,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:51,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:51,561 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:11:51,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:51,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:51,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:11:51,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:11:51,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:11:51,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:51,563 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:11:51,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:11:51,563 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:51,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:51,564 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:11:51,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:11:51,567 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:11:51,567 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:11:51,567 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:11:51,567 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:11:51,567 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:51,567 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:11:51,567 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:11:51,567 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:11:51,567 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:11:51,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:11:51,567 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:11:51,567 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:11:51,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:11:51,567 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:51,567 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:11:51,567 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:51,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:11:51,568 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:11:51,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:11:51,568 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:51,567 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:11:51,568 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:11:51,568 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:11:51,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:11:51,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:11:51,568 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:51,568 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:51,568 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:11:51,568 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:51,568 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:11:51,568 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:11:51,568 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:51,568 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:51,569 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:51,586 DEBUG [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 10:11:51,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-18 10:11:51,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-18 10:11:51,588 DEBUG [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-18 10:11:51,592 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:51,633 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-18 10:11:51,633 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:51,634 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:51,634 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1689675111482Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689675111568 (+86 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689675111568Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689675111572 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689675111585 (+13 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1689675111633 (+48 ms) 2023-07-18 10:11:51,637 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-18 10:11:51,639 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 151 msec 2023-07-18 10:11:51,741 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689675035640_0004_000001 (auth:SIMPLE) 2023-07-18 10:11:51,788 DEBUG [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 10:11:51,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-18 10:11:51,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-18 10:11:51,790 INFO [Listener at jenkins-hbase4.apache.org/34477] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/export-test/export-1689675111790 2023-07-18 10:11:51,790 INFO [Listener at jenkins-hbase4.apache.org/34477] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:44811, tgtDir=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/export-test/export-1689675111790, rawTgtDir=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/export-test/export-1689675111790, srcFsUri=hdfs://localhost:44811, srcDir=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427 2023-07-18 10:11:51,824 DEBUG [Listener at jenkins-hbase4.apache.org/34477] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44811, inputRoot=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427 2023-07-18 10:11:51,824 DEBUG [Listener at jenkins-hbase4.apache.org/34477] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1432942622_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/export-test/export-1689675111790, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/export-test/export-1689675111790/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:51,824 INFO [Listener at jenkins-hbase4.apache.org/34477] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44811, inputRoot=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427, snapshotDir=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-18 10:11:51,833 INFO [Listener at jenkins-hbase4.apache.org/34477] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/export-test/export-1689675111790/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:11:51,868 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-18 10:11:51,868 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-18 10:11:51,869 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-18 10:11:51,869 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-18 10:11:51,869 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-18 10:11:51,869 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-18 10:11:51,870 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-18 10:11:51,971 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c329d283-1f43-4a99-3860-7ed90b9830ca/hadoop-7844480557275561404.jar 2023-07-18 10:11:51,972 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-18 10:11:51,972 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-18 10:11:51,973 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-18 10:11:51,973 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-18 10:11:51,974 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-18 10:11:51,974 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-18 10:11:51,975 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-18 10:11:51,976 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-18 10:11:51,976 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-18 10:11:51,977 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-18 10:11:51,977 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-18 10:11:51,978 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-18 10:11:51,979 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-18 10:11:51,979 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-18 10:11:51,980 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-18 10:11:51,980 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-18 10:11:51,981 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 10:11:51,982 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 10:11:51,982 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 10:11:51,983 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 10:11:51,985 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 10:11:51,985 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 10:11:51,986 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 10:11:53,233 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-18 10:11:53,560 WARN [Listener at jenkins-hbase4.apache.org/34477] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-18 10:11:53,563 INFO [Listener at jenkins-hbase4.apache.org/34477] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-18 10:11:53,569 DEBUG [Listener at jenkins-hbase4.apache.org/34477] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-18 10:11:53,772 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 10:11:53,772 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 10:11:54,670 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689675035640_0005_000001 (auth:SIMPLE) 2023-07-18 10:12:00,160 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689675035640_0005_000001 (auth:SIMPLE) 2023-07-18 10:12:02,520 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689675035640_0005_000001 (auth:SIMPLE) 2023-07-18 10:12:06,443 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689675035640_0005_000001 (auth:SIMPLE) 2023-07-18 10:12:07,977 INFO [Listener at jenkins-hbase4.apache.org/34477] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-18 10:12:07,988 INFO [Listener at jenkins-hbase4.apache.org/34477] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-18 10:12:08,021 INFO [Listener at jenkins-hbase4.apache.org/34477] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:12:08,022 INFO [Listener at jenkins-hbase4.apache.org/34477] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-18 10:12:08,022 INFO [Listener at jenkins-hbase4.apache.org/34477] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-18 10:12:08,023 DEBUG [Listener at jenkins-hbase4.apache.org/34477] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_307542026_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:12:08,023 DEBUG [Listener at jenkins-hbase4.apache.org/34477] snapshot.TestExportSnapshot(367): hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-18 10:12:08,023 DEBUG [Listener at jenkins-hbase4.apache.org/34477] snapshot.TestExportSnapshot(367): hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-18 10:12:08,024 DEBUG [Listener at jenkins-hbase4.apache.org/34477] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_307542026_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/export-test/export-1689675111790/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/export-test/export-1689675111790/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:12:08,024 DEBUG [Listener at jenkins-hbase4.apache.org/34477] snapshot.TestExportSnapshot(367): hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/export-test/export-1689675111790/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-18 10:12:08,025 DEBUG [Listener at jenkins-hbase4.apache.org/34477] snapshot.TestExportSnapshot(367): hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/export-test/export-1689675111790/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-18 10:12:08,033 INFO [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:12:08,034 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:12:08,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:12:08,039 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689675128038"}]},"ts":"1689675128038"} 2023-07-18 10:12:08,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-18 10:12:08,043 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-18 10:12:08,044 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-18 10:12:08,045 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=878086fd4b9009ea71c35b6ebfbf01b0, UNASSIGN}] 2023-07-18 10:12:08,047 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=878086fd4b9009ea71c35b6ebfbf01b0, UNASSIGN 2023-07-18 10:12:08,048 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=878086fd4b9009ea71c35b6ebfbf01b0, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:12:08,048 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689675109658.878086fd4b9009ea71c35b6ebfbf01b0.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689675128048"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689675128048"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689675128048"}]},"ts":"1689675128048"} 2023-07-18 10:12:08,050 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 878086fd4b9009ea71c35b6ebfbf01b0, server=jenkins-hbase4.apache.org,37417,1689675027545}] 2023-07-18 10:12:08,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-18 10:12:08,202 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 878086fd4b9009ea71c35b6ebfbf01b0 2023-07-18 10:12:08,203 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 878086fd4b9009ea71c35b6ebfbf01b0, disabling compactions & flushes 2023-07-18 10:12:08,203 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689675109658.878086fd4b9009ea71c35b6ebfbf01b0. 2023-07-18 10:12:08,203 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689675109658.878086fd4b9009ea71c35b6ebfbf01b0. 2023-07-18 10:12:08,203 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689675109658.878086fd4b9009ea71c35b6ebfbf01b0. after waiting 0 ms 2023-07-18 10:12:08,203 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689675109658.878086fd4b9009ea71c35b6ebfbf01b0. 2023-07-18 10:12:08,246 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/878086fd4b9009ea71c35b6ebfbf01b0/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-18 10:12:08,247 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 10:12:08,249 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689675109658.878086fd4b9009ea71c35b6ebfbf01b0. 2023-07-18 10:12:08,249 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 878086fd4b9009ea71c35b6ebfbf01b0: 2023-07-18 10:12:08,255 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 878086fd4b9009ea71c35b6ebfbf01b0 2023-07-18 10:12:08,256 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=878086fd4b9009ea71c35b6ebfbf01b0, regionState=CLOSED 2023-07-18 10:12:08,256 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689675109658.878086fd4b9009ea71c35b6ebfbf01b0.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689675128256"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689675128256"}]},"ts":"1689675128256"} 2023-07-18 10:12:08,262 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-18 10:12:08,262 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 878086fd4b9009ea71c35b6ebfbf01b0, server=jenkins-hbase4.apache.org,37417,1689675027545 in 207 msec 2023-07-18 10:12:08,264 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-18 10:12:08,264 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=878086fd4b9009ea71c35b6ebfbf01b0, UNASSIGN in 217 msec 2023-07-18 10:12:08,265 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689675128265"}]},"ts":"1689675128265"} 2023-07-18 10:12:08,266 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-18 10:12:08,268 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-18 10:12:08,270 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 235 msec 2023-07-18 10:12:08,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-18 10:12:08,345 INFO [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-18 10:12:08,346 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:12:08,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:12:08,352 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:12:08,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:12:08,353 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:12:08,356 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43301] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:12:08,359 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/878086fd4b9009ea71c35b6ebfbf01b0 2023-07-18 10:12:08,360 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d9ffc3b9364d395b01e7a198dc00fbd5 2023-07-18 10:12:08,360 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/36cc259f07d70cf0cdea08a4181bf042 2023-07-18 10:12:08,361 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:12:08,361 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:12:08,361 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:12:08,361 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:12:08,361 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-18 10:12:08,361 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-18 10:12:08,362 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:12:08,363 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:12:08,363 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:12:08,363 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-07-18 10:12:08,363 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:12:08,363 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-07-18 10:12:08,363 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-18 10:12:08,362 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:12:08,363 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-18 10:12:08,363 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:12:08,363 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d9ffc3b9364d395b01e7a198dc00fbd5/cf, FileablePath, hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d9ffc3b9364d395b01e7a198dc00fbd5/recovered.edits] 2023-07-18 10:12:08,364 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-18 10:12:08,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-18 10:12:08,364 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-18 10:12:08,364 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-18 10:12:08,364 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-18 10:12:08,365 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/878086fd4b9009ea71c35b6ebfbf01b0/cf, FileablePath, hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/878086fd4b9009ea71c35b6ebfbf01b0/recovered.edits] 2023-07-18 10:12:08,366 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/36cc259f07d70cf0cdea08a4181bf042/cf, FileablePath, hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/36cc259f07d70cf0cdea08a4181bf042/recovered.edits] 2023-07-18 10:12:08,371 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d9ffc3b9364d395b01e7a198dc00fbd5/cf/4006a31ea17d4b698395789cf8cec6a9 to hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d9ffc3b9364d395b01e7a198dc00fbd5/cf/4006a31ea17d4b698395789cf8cec6a9 2023-07-18 10:12:08,374 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/878086fd4b9009ea71c35b6ebfbf01b0/cf/4006a31ea17d4b698395789cf8cec6a9.d9ffc3b9364d395b01e7a198dc00fbd5 to hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/878086fd4b9009ea71c35b6ebfbf01b0/cf/4006a31ea17d4b698395789cf8cec6a9.d9ffc3b9364d395b01e7a198dc00fbd5 2023-07-18 10:12:08,375 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/36cc259f07d70cf0cdea08a4181bf042/cf/781d15caa88e4aa1bb4bf305aa22cae6 to hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/36cc259f07d70cf0cdea08a4181bf042/cf/781d15caa88e4aa1bb4bf305aa22cae6 2023-07-18 10:12:08,377 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d9ffc3b9364d395b01e7a198dc00fbd5/recovered.edits/8.seqid to hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d9ffc3b9364d395b01e7a198dc00fbd5/recovered.edits/8.seqid 2023-07-18 10:12:08,377 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/878086fd4b9009ea71c35b6ebfbf01b0/cf/781d15caa88e4aa1bb4bf305aa22cae6.36cc259f07d70cf0cdea08a4181bf042 to hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/878086fd4b9009ea71c35b6ebfbf01b0/cf/781d15caa88e4aa1bb4bf305aa22cae6.36cc259f07d70cf0cdea08a4181bf042 2023-07-18 10:12:08,378 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d9ffc3b9364d395b01e7a198dc00fbd5 2023-07-18 10:12:08,381 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/36cc259f07d70cf0cdea08a4181bf042/recovered.edits/8.seqid to hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/36cc259f07d70cf0cdea08a4181bf042/recovered.edits/8.seqid 2023-07-18 10:12:08,381 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/36cc259f07d70cf0cdea08a4181bf042 2023-07-18 10:12:08,383 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/878086fd4b9009ea71c35b6ebfbf01b0/recovered.edits/12.seqid to hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/878086fd4b9009ea71c35b6ebfbf01b0/recovered.edits/12.seqid 2023-07-18 10:12:08,383 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/878086fd4b9009ea71c35b6ebfbf01b0 2023-07-18 10:12:08,383 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-18 10:12:08,392 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:12:08,395 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-18 10:12:08,402 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-18 10:12:08,405 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:12:08,405 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-18 10:12:08,405 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689675109658.878086fd4b9009ea71c35b6ebfbf01b0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689675128405"}]},"ts":"9223372036854775807"} 2023-07-18 10:12:08,408 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-18 10:12:08,408 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 878086fd4b9009ea71c35b6ebfbf01b0, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689675109658.878086fd4b9009ea71c35b6ebfbf01b0.', STARTKEY => '', ENDKEY => ''}] 2023-07-18 10:12:08,408 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-18 10:12:08,408 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689675128408"}]},"ts":"9223372036854775807"} 2023-07-18 10:12:08,417 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-18 10:12:08,421 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:12:08,423 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 74 msec 2023-07-18 10:12:08,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-18 10:12:08,466 INFO [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-18 10:12:08,466 INFO [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 10:12:08,466 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 10:12:08,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 10:12:08,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-18 10:12:08,472 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689675128471"}]},"ts":"1689675128471"} 2023-07-18 10:12:08,473 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-18 10:12:08,476 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-18 10:12:08,477 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=d76d20d2003fd3fe909413d09bad137e, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=30ce7c205ed3f723a7370424f91dd153, UNASSIGN}] 2023-07-18 10:12:08,479 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=d76d20d2003fd3fe909413d09bad137e, UNASSIGN 2023-07-18 10:12:08,479 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=30ce7c205ed3f723a7370424f91dd153, UNASSIGN 2023-07-18 10:12:08,480 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=30ce7c205ed3f723a7370424f91dd153, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:12:08,480 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689675107926.30ce7c205ed3f723a7370424f91dd153.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689675128480"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689675128480"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689675128480"}]},"ts":"1689675128480"} 2023-07-18 10:12:08,480 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=d76d20d2003fd3fe909413d09bad137e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:12:08,481 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689675107926.d76d20d2003fd3fe909413d09bad137e.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689675128480"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689675128480"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689675128480"}]},"ts":"1689675128480"} 2023-07-18 10:12:08,482 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=86, state=RUNNABLE; CloseRegionProcedure 30ce7c205ed3f723a7370424f91dd153, server=jenkins-hbase4.apache.org,37417,1689675027545}] 2023-07-18 10:12:08,483 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=85, state=RUNNABLE; CloseRegionProcedure d76d20d2003fd3fe909413d09bad137e, server=jenkins-hbase4.apache.org,43301,1689675027670}] 2023-07-18 10:12:08,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-18 10:12:08,633 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 30ce7c205ed3f723a7370424f91dd153 2023-07-18 10:12:08,634 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 30ce7c205ed3f723a7370424f91dd153, disabling compactions & flushes 2023-07-18 10:12:08,634 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689675107926.30ce7c205ed3f723a7370424f91dd153. 2023-07-18 10:12:08,634 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689675107926.30ce7c205ed3f723a7370424f91dd153. 2023-07-18 10:12:08,634 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689675107926.30ce7c205ed3f723a7370424f91dd153. after waiting 0 ms 2023-07-18 10:12:08,634 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689675107926.30ce7c205ed3f723a7370424f91dd153. 2023-07-18 10:12:08,639 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close d76d20d2003fd3fe909413d09bad137e 2023-07-18 10:12:08,639 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d76d20d2003fd3fe909413d09bad137e, disabling compactions & flushes 2023-07-18 10:12:08,640 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689675107926.d76d20d2003fd3fe909413d09bad137e. 2023-07-18 10:12:08,640 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689675107926.d76d20d2003fd3fe909413d09bad137e. 2023-07-18 10:12:08,640 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689675107926.d76d20d2003fd3fe909413d09bad137e. after waiting 0 ms 2023-07-18 10:12:08,640 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689675107926.d76d20d2003fd3fe909413d09bad137e. 2023-07-18 10:12:08,648 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemStateWithMergeRegion/30ce7c205ed3f723a7370424f91dd153/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-18 10:12:08,649 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 10:12:08,650 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689675107926.30ce7c205ed3f723a7370424f91dd153. 2023-07-18 10:12:08,650 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 30ce7c205ed3f723a7370424f91dd153: 2023-07-18 10:12:08,654 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemStateWithMergeRegion/d76d20d2003fd3fe909413d09bad137e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-18 10:12:08,654 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 10:12:08,655 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689675107926.d76d20d2003fd3fe909413d09bad137e. 2023-07-18 10:12:08,655 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d76d20d2003fd3fe909413d09bad137e: 2023-07-18 10:12:08,656 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 30ce7c205ed3f723a7370424f91dd153 2023-07-18 10:12:08,656 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=30ce7c205ed3f723a7370424f91dd153, regionState=CLOSED 2023-07-18 10:12:08,657 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689675107926.30ce7c205ed3f723a7370424f91dd153.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689675128656"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689675128656"}]},"ts":"1689675128656"} 2023-07-18 10:12:08,657 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed d76d20d2003fd3fe909413d09bad137e 2023-07-18 10:12:08,662 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=d76d20d2003fd3fe909413d09bad137e, regionState=CLOSED 2023-07-18 10:12:08,662 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689675107926.d76d20d2003fd3fe909413d09bad137e.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689675128662"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689675128662"}]},"ts":"1689675128662"} 2023-07-18 10:12:08,666 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=86 2023-07-18 10:12:08,666 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=86, state=SUCCESS; CloseRegionProcedure 30ce7c205ed3f723a7370424f91dd153, server=jenkins-hbase4.apache.org,37417,1689675027545 in 176 msec 2023-07-18 10:12:08,668 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=30ce7c205ed3f723a7370424f91dd153, UNASSIGN in 189 msec 2023-07-18 10:12:08,668 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=85 2023-07-18 10:12:08,668 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=85, state=SUCCESS; CloseRegionProcedure d76d20d2003fd3fe909413d09bad137e, server=jenkins-hbase4.apache.org,43301,1689675027670 in 183 msec 2023-07-18 10:12:08,669 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=85, resume processing ppid=84 2023-07-18 10:12:08,670 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=d76d20d2003fd3fe909413d09bad137e, UNASSIGN in 191 msec 2023-07-18 10:12:08,670 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689675128670"}]},"ts":"1689675128670"} 2023-07-18 10:12:08,672 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-18 10:12:08,674 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-18 10:12:08,675 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 208 msec 2023-07-18 10:12:08,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-18 10:12:08,774 INFO [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-18 10:12:08,775 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 10:12:08,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 10:12:08,778 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 10:12:08,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 10:12:08,779 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 10:12:08,781 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43301] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 10:12:08,784 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d76d20d2003fd3fe909413d09bad137e 2023-07-18 10:12:08,784 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/30ce7c205ed3f723a7370424f91dd153 2023-07-18 10:12:08,787 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d76d20d2003fd3fe909413d09bad137e/cf, FileablePath, hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d76d20d2003fd3fe909413d09bad137e/recovered.edits] 2023-07-18 10:12:08,787 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/30ce7c205ed3f723a7370424f91dd153/cf, FileablePath, hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/30ce7c205ed3f723a7370424f91dd153/recovered.edits] 2023-07-18 10:12:08,790 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 10:12:08,790 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 10:12:08,790 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 10:12:08,790 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-18 10:12:08,790 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-18 10:12:08,791 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-18 10:12:08,792 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 10:12:08,792 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:12:08,792 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 10:12:08,792 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 10:12:08,792 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:12:08,792 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:12:08,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-18 10:12:08,794 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 10:12:08,794 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:12:08,794 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data null 2023-07-18 10:12:08,794 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d76d20d2003fd3fe909413d09bad137e/cf/5be07002a87648fda3a3cbfd37de580c to hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/d76d20d2003fd3fe909413d09bad137e/cf/5be07002a87648fda3a3cbfd37de580c 2023-07-18 10:12:08,794 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-18 10:12:08,795 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/30ce7c205ed3f723a7370424f91dd153/cf/9821fc74d2644af296e671412f526121 to hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/30ce7c205ed3f723a7370424f91dd153/cf/9821fc74d2644af296e671412f526121 2023-07-18 10:12:08,798 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d76d20d2003fd3fe909413d09bad137e/recovered.edits/9.seqid to hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/d76d20d2003fd3fe909413d09bad137e/recovered.edits/9.seqid 2023-07-18 10:12:08,798 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/30ce7c205ed3f723a7370424f91dd153/recovered.edits/9.seqid to hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/30ce7c205ed3f723a7370424f91dd153/recovered.edits/9.seqid 2023-07-18 10:12:08,799 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d76d20d2003fd3fe909413d09bad137e 2023-07-18 10:12:08,799 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/30ce7c205ed3f723a7370424f91dd153 2023-07-18 10:12:08,799 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-18 10:12:08,799 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-18 10:12:08,800 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-07-18 10:12:08,804 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230718e0b6a0d646e040799845ff16e0e4042b to hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230718e0b6a0d646e040799845ff16e0e4042b 2023-07-18 10:12:08,806 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230718834a0839e6d04853b4eae40dbad25ba7 to hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230718834a0839e6d04853b4eae40dbad25ba7 2023-07-18 10:12:08,810 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-18 10:12:08,813 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 10:12:08,815 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-18 10:12:08,817 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-18 10:12:08,818 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 10:12:08,818 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-18 10:12:08,818 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689675107926.d76d20d2003fd3fe909413d09bad137e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689675128818"}]},"ts":"9223372036854775807"} 2023-07-18 10:12:08,818 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689675107926.30ce7c205ed3f723a7370424f91dd153.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689675128818"}]},"ts":"9223372036854775807"} 2023-07-18 10:12:08,820 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-18 10:12:08,820 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => d76d20d2003fd3fe909413d09bad137e, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689675107926.d76d20d2003fd3fe909413d09bad137e.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 30ce7c205ed3f723a7370424f91dd153, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689675107926.30ce7c205ed3f723a7370424f91dd153.', STARTKEY => '1', ENDKEY => ''}] 2023-07-18 10:12:08,820 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-18 10:12:08,820 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689675128820"}]},"ts":"9223372036854775807"} 2023-07-18 10:12:08,822 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-18 10:12:08,823 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 10:12:08,825 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 49 msec 2023-07-18 10:12:08,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-18 10:12:08,895 INFO [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-18 10:12:08,905 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-18 10:12:08,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:12:08,909 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-18 10:12:08,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 10:12:08,912 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-18 10:12:08,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 10:12:08,939 INFO [Listener at jenkins-hbase4.apache.org/34477] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=757 (was 744) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4106 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-818080736_1 at /127.0.0.1:54888 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x36ae74de-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x36ae74de-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x36ae74de-shared-pool-28 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_307542026_17 at /127.0.0.1:54934 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-818080736_1 at /127.0.0.1:51426 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1988502388) connection to jenkins-hbase4.apache.org/172.31.14.131:40317 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x36ae74de-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_307542026_17 at /127.0.0.1:51444 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x36ae74de-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_307542026_17 at /127.0.0.1:50396 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x36ae74de-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=906 (was 897) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=488 (was 425) - SystemLoadAverage LEAK? -, ProcessCount=184 (was 184), AvailableMemoryMB=2337 (was 2372) 2023-07-18 10:12:08,939 WARN [Listener at jenkins-hbase4.apache.org/34477] hbase.ResourceChecker(130): Thread=757 is superior to 500 2023-07-18 10:12:08,963 INFO [Listener at jenkins-hbase4.apache.org/34477] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=757, OpenFileDescriptor=906, MaxFileDescriptor=60000, SystemLoadAverage=488, ProcessCount=184, AvailableMemoryMB=2315 2023-07-18 10:12:08,963 WARN [Listener at jenkins-hbase4.apache.org/34477] hbase.ResourceChecker(130): Thread=757 is superior to 500 2023-07-18 10:12:08,965 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-18 10:12:08,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-18 10:12:08,974 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-18 10:12:08,974 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-18 10:12:08,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-18 10:12:08,976 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-18 10:12:08,979 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testEmptyExportFileSystemState/66c0f03bc424a8048ec7ccacf1fe7bef 2023-07-18 10:12:08,979 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testEmptyExportFileSystemState/6b02a58b240dd6284579a47d3b8b917a 2023-07-18 10:12:08,979 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testEmptyExportFileSystemState/66c0f03bc424a8048ec7ccacf1fe7bef empty. 2023-07-18 10:12:08,979 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testEmptyExportFileSystemState/6b02a58b240dd6284579a47d3b8b917a empty. 2023-07-18 10:12:08,980 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testEmptyExportFileSystemState/66c0f03bc424a8048ec7ccacf1fe7bef 2023-07-18 10:12:08,980 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testEmptyExportFileSystemState/6b02a58b240dd6284579a47d3b8b917a 2023-07-18 10:12:08,980 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-18 10:12:08,998 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-18 10:12:09,003 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 66c0f03bc424a8048ec7ccacf1fe7bef, NAME => 'testtb-testEmptyExportFileSystemState,,1689675128965.66c0f03bc424a8048ec7ccacf1fe7bef.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp 2023-07-18 10:12:09,004 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 6b02a58b240dd6284579a47d3b8b917a, NAME => 'testtb-testEmptyExportFileSystemState,1,1689675128965.6b02a58b240dd6284579a47d3b8b917a.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp 2023-07-18 10:12:09,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-18 10:12:09,114 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689675128965.66c0f03bc424a8048ec7ccacf1fe7bef.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 10:12:09,114 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 66c0f03bc424a8048ec7ccacf1fe7bef, disabling compactions & flushes 2023-07-18 10:12:09,114 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689675128965.66c0f03bc424a8048ec7ccacf1fe7bef. 2023-07-18 10:12:09,114 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689675128965.66c0f03bc424a8048ec7ccacf1fe7bef. 2023-07-18 10:12:09,114 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689675128965.66c0f03bc424a8048ec7ccacf1fe7bef. after waiting 0 ms 2023-07-18 10:12:09,114 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689675128965.66c0f03bc424a8048ec7ccacf1fe7bef. 2023-07-18 10:12:09,114 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689675128965.66c0f03bc424a8048ec7ccacf1fe7bef. 2023-07-18 10:12:09,115 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 66c0f03bc424a8048ec7ccacf1fe7bef: 2023-07-18 10:12:09,115 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689675128965.6b02a58b240dd6284579a47d3b8b917a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 10:12:09,115 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 6b02a58b240dd6284579a47d3b8b917a, disabling compactions & flushes 2023-07-18 10:12:09,115 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689675128965.6b02a58b240dd6284579a47d3b8b917a. 2023-07-18 10:12:09,115 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689675128965.6b02a58b240dd6284579a47d3b8b917a. 2023-07-18 10:12:09,115 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689675128965.6b02a58b240dd6284579a47d3b8b917a. after waiting 0 ms 2023-07-18 10:12:09,115 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689675128965.6b02a58b240dd6284579a47d3b8b917a. 2023-07-18 10:12:09,115 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689675128965.6b02a58b240dd6284579a47d3b8b917a. 2023-07-18 10:12:09,115 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 6b02a58b240dd6284579a47d3b8b917a: 2023-07-18 10:12:09,118 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-18 10:12:09,119 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689675128965.66c0f03bc424a8048ec7ccacf1fe7bef.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689675129119"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689675129119"}]},"ts":"1689675129119"} 2023-07-18 10:12:09,119 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689675128965.6b02a58b240dd6284579a47d3b8b917a.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689675129119"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689675129119"}]},"ts":"1689675129119"} 2023-07-18 10:12:09,121 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-18 10:12:09,122 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-18 10:12:09,122 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689675129122"}]},"ts":"1689675129122"} 2023-07-18 10:12:09,123 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-18 10:12:09,126 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 10:12:09,127 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 10:12:09,127 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 10:12:09,127 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-18 10:12:09,127 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 10:12:09,127 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=66c0f03bc424a8048ec7ccacf1fe7bef, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6b02a58b240dd6284579a47d3b8b917a, ASSIGN}] 2023-07-18 10:12:09,129 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6b02a58b240dd6284579a47d3b8b917a, ASSIGN 2023-07-18 10:12:09,129 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=66c0f03bc424a8048ec7ccacf1fe7bef, ASSIGN 2023-07-18 10:12:09,130 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6b02a58b240dd6284579a47d3b8b917a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37417,1689675027545; forceNewPlan=false, retain=false 2023-07-18 10:12:09,130 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=66c0f03bc424a8048ec7ccacf1fe7bef, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43301,1689675027670; forceNewPlan=false, retain=false 2023-07-18 10:12:09,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-18 10:12:09,280 INFO [jenkins-hbase4:38235] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-18 10:12:09,284 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=6b02a58b240dd6284579a47d3b8b917a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:12:09,284 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=66c0f03bc424a8048ec7ccacf1fe7bef, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:12:09,284 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689675128965.6b02a58b240dd6284579a47d3b8b917a.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689675129284"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689675129284"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689675129284"}]},"ts":"1689675129284"} 2023-07-18 10:12:09,284 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689675128965.66c0f03bc424a8048ec7ccacf1fe7bef.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689675129284"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689675129284"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689675129284"}]},"ts":"1689675129284"} 2023-07-18 10:12:09,286 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=92, state=RUNNABLE; OpenRegionProcedure 6b02a58b240dd6284579a47d3b8b917a, server=jenkins-hbase4.apache.org,37417,1689675027545}] 2023-07-18 10:12:09,288 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; OpenRegionProcedure 66c0f03bc424a8048ec7ccacf1fe7bef, server=jenkins-hbase4.apache.org,43301,1689675027670}] 2023-07-18 10:12:09,445 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1689675128965.6b02a58b240dd6284579a47d3b8b917a. 2023-07-18 10:12:09,445 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6b02a58b240dd6284579a47d3b8b917a, NAME => 'testtb-testEmptyExportFileSystemState,1,1689675128965.6b02a58b240dd6284579a47d3b8b917a.', STARTKEY => '1', ENDKEY => ''} 2023-07-18 10:12:09,445 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1689675128965.6b02a58b240dd6284579a47d3b8b917a. service=AccessControlService 2023-07-18 10:12:09,445 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1689675128965.66c0f03bc424a8048ec7ccacf1fe7bef. 2023-07-18 10:12:09,446 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 66c0f03bc424a8048ec7ccacf1fe7bef, NAME => 'testtb-testEmptyExportFileSystemState,,1689675128965.66c0f03bc424a8048ec7ccacf1fe7bef.', STARTKEY => '', ENDKEY => '1'} 2023-07-18 10:12:09,446 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 10:12:09,446 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 6b02a58b240dd6284579a47d3b8b917a 2023-07-18 10:12:09,446 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1689675128965.66c0f03bc424a8048ec7ccacf1fe7bef. service=AccessControlService 2023-07-18 10:12:09,446 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689675128965.6b02a58b240dd6284579a47d3b8b917a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 10:12:09,446 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6b02a58b240dd6284579a47d3b8b917a 2023-07-18 10:12:09,446 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6b02a58b240dd6284579a47d3b8b917a 2023-07-18 10:12:09,446 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 10:12:09,446 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 66c0f03bc424a8048ec7ccacf1fe7bef 2023-07-18 10:12:09,446 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689675128965.66c0f03bc424a8048ec7ccacf1fe7bef.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 10:12:09,447 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 66c0f03bc424a8048ec7ccacf1fe7bef 2023-07-18 10:12:09,447 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 66c0f03bc424a8048ec7ccacf1fe7bef 2023-07-18 10:12:09,448 INFO [StoreOpener-6b02a58b240dd6284579a47d3b8b917a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 6b02a58b240dd6284579a47d3b8b917a 2023-07-18 10:12:09,448 INFO [StoreOpener-66c0f03bc424a8048ec7ccacf1fe7bef-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 66c0f03bc424a8048ec7ccacf1fe7bef 2023-07-18 10:12:09,450 DEBUG [StoreOpener-6b02a58b240dd6284579a47d3b8b917a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testEmptyExportFileSystemState/6b02a58b240dd6284579a47d3b8b917a/cf 2023-07-18 10:12:09,450 DEBUG [StoreOpener-6b02a58b240dd6284579a47d3b8b917a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testEmptyExportFileSystemState/6b02a58b240dd6284579a47d3b8b917a/cf 2023-07-18 10:12:09,450 DEBUG [StoreOpener-66c0f03bc424a8048ec7ccacf1fe7bef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testEmptyExportFileSystemState/66c0f03bc424a8048ec7ccacf1fe7bef/cf 2023-07-18 10:12:09,451 DEBUG [StoreOpener-66c0f03bc424a8048ec7ccacf1fe7bef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testEmptyExportFileSystemState/66c0f03bc424a8048ec7ccacf1fe7bef/cf 2023-07-18 10:12:09,450 INFO [StoreOpener-6b02a58b240dd6284579a47d3b8b917a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6b02a58b240dd6284579a47d3b8b917a columnFamilyName cf 2023-07-18 10:12:09,451 INFO [StoreOpener-66c0f03bc424a8048ec7ccacf1fe7bef-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 66c0f03bc424a8048ec7ccacf1fe7bef columnFamilyName cf 2023-07-18 10:12:09,453 INFO [StoreOpener-6b02a58b240dd6284579a47d3b8b917a-1] regionserver.HStore(310): Store=6b02a58b240dd6284579a47d3b8b917a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 10:12:09,453 INFO [StoreOpener-66c0f03bc424a8048ec7ccacf1fe7bef-1] regionserver.HStore(310): Store=66c0f03bc424a8048ec7ccacf1fe7bef/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 10:12:09,454 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testEmptyExportFileSystemState/6b02a58b240dd6284579a47d3b8b917a 2023-07-18 10:12:09,454 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testEmptyExportFileSystemState/6b02a58b240dd6284579a47d3b8b917a 2023-07-18 10:12:09,459 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testEmptyExportFileSystemState/66c0f03bc424a8048ec7ccacf1fe7bef 2023-07-18 10:12:09,459 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testEmptyExportFileSystemState/66c0f03bc424a8048ec7ccacf1fe7bef 2023-07-18 10:12:09,462 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6b02a58b240dd6284579a47d3b8b917a 2023-07-18 10:12:09,463 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 66c0f03bc424a8048ec7ccacf1fe7bef 2023-07-18 10:12:09,470 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testEmptyExportFileSystemState/6b02a58b240dd6284579a47d3b8b917a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 10:12:09,471 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6b02a58b240dd6284579a47d3b8b917a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66481359, jitterRate=-0.009350553154945374}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 10:12:09,471 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6b02a58b240dd6284579a47d3b8b917a: 2023-07-18 10:12:09,472 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1689675128965.6b02a58b240dd6284579a47d3b8b917a., pid=93, masterSystemTime=1689675129441 2023-07-18 10:12:09,474 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testEmptyExportFileSystemState/66c0f03bc424a8048ec7ccacf1fe7bef/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 10:12:09,475 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1689675128965.6b02a58b240dd6284579a47d3b8b917a. 2023-07-18 10:12:09,475 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 66c0f03bc424a8048ec7ccacf1fe7bef; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68008627, jitterRate=0.013407513499259949}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 10:12:09,475 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1689675128965.6b02a58b240dd6284579a47d3b8b917a. 2023-07-18 10:12:09,475 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 66c0f03bc424a8048ec7ccacf1fe7bef: 2023-07-18 10:12:09,475 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=6b02a58b240dd6284579a47d3b8b917a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:12:09,475 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1689675128965.66c0f03bc424a8048ec7ccacf1fe7bef., pid=94, masterSystemTime=1689675129443 2023-07-18 10:12:09,475 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1689675128965.6b02a58b240dd6284579a47d3b8b917a.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689675129475"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689675129475"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689675129475"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689675129475"}]},"ts":"1689675129475"} 2023-07-18 10:12:09,478 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1689675128965.66c0f03bc424a8048ec7ccacf1fe7bef. 2023-07-18 10:12:09,478 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1689675128965.66c0f03bc424a8048ec7ccacf1fe7bef. 2023-07-18 10:12:09,478 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=66c0f03bc424a8048ec7ccacf1fe7bef, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:12:09,478 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1689675128965.66c0f03bc424a8048ec7ccacf1fe7bef.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689675129478"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689675129478"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689675129478"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689675129478"}]},"ts":"1689675129478"} 2023-07-18 10:12:09,481 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=92 2023-07-18 10:12:09,481 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=92, state=SUCCESS; OpenRegionProcedure 6b02a58b240dd6284579a47d3b8b917a, server=jenkins-hbase4.apache.org,37417,1689675027545 in 192 msec 2023-07-18 10:12:09,483 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=91 2023-07-18 10:12:09,483 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6b02a58b240dd6284579a47d3b8b917a, ASSIGN in 354 msec 2023-07-18 10:12:09,483 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=91, state=SUCCESS; OpenRegionProcedure 66c0f03bc424a8048ec7ccacf1fe7bef, server=jenkins-hbase4.apache.org,43301,1689675027670 in 192 msec 2023-07-18 10:12:09,485 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=91, resume processing ppid=90 2023-07-18 10:12:09,485 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=66c0f03bc424a8048ec7ccacf1fe7bef, ASSIGN in 356 msec 2023-07-18 10:12:09,486 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-18 10:12:09,486 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689675129486"}]},"ts":"1689675129486"} 2023-07-18 10:12:09,488 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-18 10:12:09,492 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-18 10:12:09,493 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-18 10:12:09,495 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43301] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-18 10:12:09,496 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:12:09,496 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:12:09,496 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:12:09,497 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:12:09,498 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-18 10:12:09,498 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-18 10:12:09,498 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-18 10:12:09,499 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-18 10:12:09,500 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 533 msec 2023-07-18 10:12:09,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-18 10:12:09,580 INFO [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-18 10:12:09,583 DEBUG [Listener at jenkins-hbase4.apache.org/34477] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-18 10:12:09,583 DEBUG [Listener at jenkins-hbase4.apache.org/34477] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689675128965.66c0f03bc424a8048ec7ccacf1fe7bef. 2023-07-18 10:12:09,585 INFO [Listener at jenkins-hbase4.apache.org/34477] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 10:12:09,596 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-18 10:12:09,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689675129597 (current time:1689675129597). 2023-07-18 10:12:09,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-18 10:12:09,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] zookeeper.ReadOnlyZKClient(139): Connect 0x3f6828dd to 127.0.0.1:60990 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 10:12:09,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@31f509dc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 10:12:09,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 10:12:09,611 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42624, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 10:12:09,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3f6828dd to 127.0.0.1:60990 2023-07-18 10:12:09,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 10:12:09,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] zookeeper.ReadOnlyZKClient(139): Connect 0x57b3a9c9 to 127.0.0.1:60990 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 10:12:09,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@29635d22, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 10:12:09,627 DEBUG [hconnection-0x30c10a3b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 10:12:09,629 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42638, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 10:12:09,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 10:12:09,636 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60786, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 10:12:09,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x57b3a9c9 to 127.0.0.1:60990 2023-07-18 10:12:09,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 10:12:09,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-18 10:12:09,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-18 10:12:09,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-18 10:12:09,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-18 10:12:09,642 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-18 10:12:09,643 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689675729643 2023-07-18 10:12:09,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-18 10:12:09,643 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-18 10:12:09,644 DEBUG [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-18 10:12:09,644 DEBUG [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-18 10:12:09,646 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-18 10:12:09,647 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-18 10:12:09,648 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-07-18 10:12:09,651 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-18 10:12:09,652 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689675729652 2023-07-18 10:12:09,666 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:09,666 INFO [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-18 10:12:09,666 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:12:09,668 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-18 10:12:09,668 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-18 10:12:09,669 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:09,669 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:09,675 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:12:09,675 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:12:09,675 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:12:09,675 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:12:09,675 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:12:09,675 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:12:09,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:12:09,675 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:12:09,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:12:09,675 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:12:09,675 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:12:09,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:12:09,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:09,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:09,676 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:12:09,676 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-18 10:12:09,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:09,676 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:09,676 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:09,676 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:09,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-18 10:12:09,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:09,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-18 10:12:09,677 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-18 10:12:09,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-18 10:12:09,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:09,677 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-18 10:12:09,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:09,677 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-18 10:12:09,678 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:09,679 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-18 10:12:09,679 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:12:09,692 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-18 10:12:09,692 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-18 10:12:09,692 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43301,1689675027670' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-18 10:12:09,692 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:09,692 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-18 10:12:09,692 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:12:09,692 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:09,693 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-18 10:12:09,693 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:12:09,694 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:12:09,694 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:09,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:12:09,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:12:09,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:12:09,695 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:09,695 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 10:12:09,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:12:09,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:12:09,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:09,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:12:09,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:12:09,697 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43301,1689675027670' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-18 10:12:09,697 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@746c781e[Count = 1] remaining members to acquire global barrier 2023-07-18 10:12:09,704 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-18 10:12:09,704 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-18 10:12:09,704 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-18 10:12:09,704 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39709,1689675027617' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-18 10:12:09,704 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-18 10:12:09,704 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37417,1689675027545' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-18 10:12:09,706 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:09,706 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:12:09,706 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:09,707 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:09,707 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 10:12:09,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:12:09,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:12:09,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:12:09,707 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:09,707 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 10:12:09,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:12:09,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:12:09,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:09,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:12:09,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:12:09,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:12:09,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:12:09,710 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37417,1689675027545' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-18 10:12:09,710 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@746c781e[Count = 0] remaining members to acquire global barrier 2023-07-18 10:12:09,710 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-18 10:12:09,710 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:09,712 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:09,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:09,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:09,712 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-18 10:12:09,713 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-18 10:12:09,713 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39709,1689675027617' in zk 2023-07-18 10:12:09,712 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:09,713 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:09,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:09,713 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-18 10:12:09,713 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:12:09,713 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 10:12:09,713 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 10:12:09,713 DEBUG [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689675128965.6b02a58b240dd6284579a47d3b8b917a. 2023-07-18 10:12:09,713 DEBUG [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689675128965.6b02a58b240dd6284579a47d3b8b917a. started... 2023-07-18 10:12:09,716 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:09,716 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:09,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:09,717 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:12:09,717 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-18 10:12:09,717 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-18 10:12:09,717 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-18 10:12:09,718 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:12:09,718 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-18 10:12:09,720 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 10:12:09,720 DEBUG [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689675128965.66c0f03bc424a8048ec7ccacf1fe7bef. 2023-07-18 10:12:09,720 DEBUG [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689675128965.66c0f03bc424a8048ec7ccacf1fe7bef. started... 2023-07-18 10:12:09,720 DEBUG [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6b02a58b240dd6284579a47d3b8b917a: 2023-07-18 10:12:09,720 DEBUG [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 66c0f03bc424a8048ec7ccacf1fe7bef: 2023-07-18 10:12:09,720 DEBUG [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689675128965.6b02a58b240dd6284579a47d3b8b917a.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:09,720 DEBUG [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 10:12:09,721 DEBUG [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-18 10:12:09,720 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 10:12:09,721 DEBUG [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689675128965.66c0f03bc424a8048ec7ccacf1fe7bef.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:09,722 DEBUG [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 10:12:09,722 DEBUG [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-18 10:12:09,744 DEBUG [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 10:12:09,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-18 10:12:09,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-18 10:12:09,746 DEBUG [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-18 10:12:09,759 DEBUG [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689675128965.66c0f03bc424a8048ec7ccacf1fe7bef. completed. 2023-07-18 10:12:09,759 DEBUG [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689675128965.66c0f03bc424a8048ec7ccacf1fe7bef. 2023-07-18 10:12:09,760 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 10:12:09,760 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 10:12:09,760 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:12:09,760 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-18 10:12:09,760 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43301,1689675027670' in zk 2023-07-18 10:12:09,761 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:12:09,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:12:09,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:12:09,762 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-18 10:12:09,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:12:09,762 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:12:09,762 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-18 10:12:09,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:12:09,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:12:09,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:09,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:12:09,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:12:09,765 DEBUG [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689675128965.6b02a58b240dd6284579a47d3b8b917a. completed. 2023-07-18 10:12:09,765 DEBUG [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689675128965.6b02a58b240dd6284579a47d3b8b917a. 2023-07-18 10:12:09,765 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 10:12:09,765 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 10:12:09,765 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:12:09,765 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-18 10:12:09,765 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37417,1689675027545' in zk 2023-07-18 10:12:09,766 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:12:09,767 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-18 10:12:09,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:12:09,767 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:12:09,767 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-18 10:12:09,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:12:09,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:09,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:12:09,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:12:09,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:12:09,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,43301,1689675027670': 2023-07-18 10:12:09,770 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43301,1689675027670' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-18 10:12:09,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:12:09,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:12:09,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:12:09,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:12:09,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:12:09,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:09,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:12:09,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:12:09,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:12:09,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:12:09,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:09,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:12:09,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:12:09,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:12:09,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,37417,1689675027545': 2023-07-18 10:12:09,774 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37417,1689675027545' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-18 10:12:09,774 INFO [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-18 10:12:09,774 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-18 10:12:09,774 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-18 10:12:09,774 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:09,774 INFO [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-18 10:12:09,782 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:09,782 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:09,782 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:09,782 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:09,782 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:09,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:09,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:09,782 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:12:09,782 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:12:09,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:09,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:12:09,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:12:09,782 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:09,782 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:12:09,782 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:09,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:09,783 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:12:09,783 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:12:09,783 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:12:09,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:12:09,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:12:09,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:12:09,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:12:09,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:09,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:09,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:12:09,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:09,786 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:12:09,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:09,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:12:09,786 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:12:09,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:09,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:12:09,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:12:09,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:12:09,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:12:09,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:09,789 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:12:09,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:12:09,789 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:12:09,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:12:09,791 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:12:09,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:12:09,794 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:12:09,794 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:12:09,794 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:12:09,794 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:09,794 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:12:09,794 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:12:09,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:12:09,794 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:12:09,794 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:09,794 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:12:09,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:12:09,794 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:12:09,795 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:09,794 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:12:09,795 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:12:09,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:12:09,795 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:12:09,797 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:09,797 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:12:09,797 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:12:09,795 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-18 10:12:09,795 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:12:09,797 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:09,797 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:12:09,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:12:09,794 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:12:09,797 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-18 10:12:09,797 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:12:09,797 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:09,797 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:09,798 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:12:09,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:12:09,798 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:12:09,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:12:09,798 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-18 10:12:09,813 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:09,814 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:09,877 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:09,913 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-18 10:12:09,913 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:09,914 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:09,914 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689675129643Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1689675129813 (+170 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689675129813Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1689675129813Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1689675129828 (+15 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689675129857 (+29 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689675129913 (+56 ms) 2023-07-18 10:12:09,917 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-18 10:12:09,919 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 274 msec 2023-07-18 10:12:09,946 DEBUG [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 10:12:09,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-18 10:12:09,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-18 10:12:09,949 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43301] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1689675128965.66c0f03bc424a8048ec7ccacf1fe7bef. with WAL disabled. Data may be lost in the event of a crash. 2023-07-18 10:12:09,951 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37417] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1689675128965.6b02a58b240dd6284579a47d3b8b917a. with WAL disabled. Data may be lost in the event of a crash. 2023-07-18 10:12:09,954 DEBUG [Listener at jenkins-hbase4.apache.org/34477] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-18 10:12:09,954 DEBUG [Listener at jenkins-hbase4.apache.org/34477] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689675128965.66c0f03bc424a8048ec7ccacf1fe7bef. 2023-07-18 10:12:09,954 INFO [Listener at jenkins-hbase4.apache.org/34477] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 10:12:09,965 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-18 10:12:09,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689675129965 (current time:1689675129965). 2023-07-18 10:12:09,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-18 10:12:09,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] zookeeper.ReadOnlyZKClient(139): Connect 0x33212f35 to 127.0.0.1:60990 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 10:12:09,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@b896bb8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 10:12:09,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 10:12:09,993 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42640, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 10:12:09,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x33212f35 to 127.0.0.1:60990 2023-07-18 10:12:09,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 10:12:09,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] zookeeper.ReadOnlyZKClient(139): Connect 0x79670c16 to 127.0.0.1:60990 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 10:12:10,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4305cc88, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 10:12:10,011 DEBUG [hconnection-0x391abfb-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 10:12:10,012 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42654, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 10:12:10,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 10:12:10,017 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60790, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 10:12:10,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x79670c16 to 127.0.0.1:60990 2023-07-18 10:12:10,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 10:12:10,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-18 10:12:10,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-18 10:12:10,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-18 10:12:10,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-18 10:12:10,025 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-18 10:12:10,030 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689675730030 2023-07-18 10:12:10,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-18 10:12:10,031 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-18 10:12:10,032 DEBUG [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-18 10:12:10,032 DEBUG [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-18 10:12:10,032 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-18 10:12:10,033 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-18 10:12:10,034 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 12 msec 2023-07-18 10:12:10,035 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-18 10:12:10,036 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689675730036 2023-07-18 10:12:10,054 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:10,055 INFO [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-18 10:12:10,055 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:12:10,056 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-18 10:12:10,056 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-18 10:12:10,057 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:10,057 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:10,058 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:12:10,058 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:12:10,058 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:12:10,058 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:12:10,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:12:10,058 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:12:10,058 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:12:10,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:12:10,058 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:12:10,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:12:10,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:10,059 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:12:10,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:10,059 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:12:10,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:10,059 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:10,059 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:10,060 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:12:10,060 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-18 10:12:10,060 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:10,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-18 10:12:10,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:10,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-18 10:12:10,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:10,060 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-18 10:12:10,060 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-18 10:12:10,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-18 10:12:10,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:10,061 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-18 10:12:10,066 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:10,066 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:10,066 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:10,066 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-18 10:12:10,066 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-18 10:12:10,066 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:12:10,066 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-18 10:12:10,068 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-18 10:12:10,068 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-18 10:12:10,066 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:12:10,068 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39709,1689675027617' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-18 10:12:10,068 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:12:10,069 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-18 10:12:10,072 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-18 10:12:10,072 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-18 10:12:10,072 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-18 10:12:10,072 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37417,1689675027545' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-18 10:12:10,072 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43301,1689675027670' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-18 10:12:10,074 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:10,076 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:12:10,076 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:10,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:12:10,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:12:10,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:12:10,076 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 10:12:10,076 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:12:10,076 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:10,076 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:10,076 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 10:12:10,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:12:10,077 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:10,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:12:10,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:10,081 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:10,081 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 10:12:10,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:12:10,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:12:10,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:12:10,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:12:10,082 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37417,1689675027545' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-18 10:12:10,082 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@424fc023[Count = 1] remaining members to acquire global barrier 2023-07-18 10:12:10,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:12:10,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:12:10,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:12:10,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:12:10,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:12:10,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:10,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:12:10,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:12:10,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:12:10,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:12:10,085 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43301,1689675027670' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-18 10:12:10,085 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@424fc023[Count = 0] remaining members to acquire global barrier 2023-07-18 10:12:10,085 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-18 10:12:10,085 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:10,089 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:10,089 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:10,089 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:10,090 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:10,089 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:10,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:10,090 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:12:10,090 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-18 10:12:10,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:10,090 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:10,090 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-18 10:12:10,090 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-18 10:12:10,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:10,090 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39709,1689675027617' in zk 2023-07-18 10:12:10,090 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:12:10,090 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-18 10:12:10,090 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 10:12:10,090 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-18 10:12:10,090 DEBUG [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689675128965.66c0f03bc424a8048ec7ccacf1fe7bef. 2023-07-18 10:12:10,090 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 10:12:10,090 DEBUG [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689675128965.66c0f03bc424a8048ec7ccacf1fe7bef. started... 2023-07-18 10:12:10,091 INFO [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 66c0f03bc424a8048ec7ccacf1fe7bef 1/1 column families, dataSize=65 B heapSize=400 B 2023-07-18 10:12:10,091 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-18 10:12:10,092 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:12:10,092 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-18 10:12:10,097 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 10:12:10,097 DEBUG [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689675128965.6b02a58b240dd6284579a47d3b8b917a. 2023-07-18 10:12:10,097 DEBUG [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689675128965.6b02a58b240dd6284579a47d3b8b917a. started... 2023-07-18 10:12:10,097 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 10:12:10,097 INFO [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 6b02a58b240dd6284579a47d3b8b917a 1/1 column families, dataSize=3.19 KB heapSize=7.14 KB 2023-07-18 10:12:10,132 DEBUG [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 10:12:10,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-18 10:12:10,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-18 10:12:10,135 DEBUG [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-18 10:12:10,160 INFO [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230718047f34a3f31f435aa2038efa61f81ed1 to hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230718047f34a3f31f435aa2038efa61f81ed1 2023-07-18 10:12:10,171 INFO [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307186bb087920a9d4844bde0340618ce10ec to hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202307186bb087920a9d4844bde0340618ce10ec 2023-07-18 10:12:10,181 INFO [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.2 K, hasBloomFilter=true, into tmp file hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testEmptyExportFileSystemState/6b02a58b240dd6284579a47d3b8b917a/.tmp/cf/370859ce4dda41038bc1252e7921d612 2023-07-18 10:12:10,185 INFO [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=65, hasBloomFilter=true, into tmp file hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testEmptyExportFileSystemState/66c0f03bc424a8048ec7ccacf1fe7bef/.tmp/cf/b978502c580c451c9f8598dddfc368ef 2023-07-18 10:12:10,187 DEBUG [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testEmptyExportFileSystemState/6b02a58b240dd6284579a47d3b8b917a/.tmp/cf/370859ce4dda41038bc1252e7921d612 as hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testEmptyExportFileSystemState/6b02a58b240dd6284579a47d3b8b917a/cf/370859ce4dda41038bc1252e7921d612 2023-07-18 10:12:10,191 DEBUG [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testEmptyExportFileSystemState/66c0f03bc424a8048ec7ccacf1fe7bef/.tmp/cf/b978502c580c451c9f8598dddfc368ef as hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testEmptyExportFileSystemState/66c0f03bc424a8048ec7ccacf1fe7bef/cf/b978502c580c451c9f8598dddfc368ef 2023-07-18 10:12:10,192 INFO [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testEmptyExportFileSystemState/6b02a58b240dd6284579a47d3b8b917a/cf/370859ce4dda41038bc1252e7921d612, entries=49, sequenceid=6, filesize=13.4 K 2023-07-18 10:12:10,193 INFO [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.19 KB/3271, heapSize ~7.13 KB/7296, currentSize=0 B/0 for 6b02a58b240dd6284579a47d3b8b917a in 96ms, sequenceid=6, compaction requested=false 2023-07-18 10:12:10,193 DEBUG [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-18 10:12:10,194 DEBUG [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6b02a58b240dd6284579a47d3b8b917a: 2023-07-18 10:12:10,194 DEBUG [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689675128965.6b02a58b240dd6284579a47d3b8b917a.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:10,196 DEBUG [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 10:12:10,196 DEBUG [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testEmptyExportFileSystemState/6b02a58b240dd6284579a47d3b8b917a/cf/370859ce4dda41038bc1252e7921d612] hfiles 2023-07-18 10:12:10,196 DEBUG [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testEmptyExportFileSystemState/6b02a58b240dd6284579a47d3b8b917a/cf/370859ce4dda41038bc1252e7921d612 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:10,198 INFO [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testEmptyExportFileSystemState/66c0f03bc424a8048ec7ccacf1fe7bef/cf/b978502c580c451c9f8598dddfc368ef, entries=1, sequenceid=6, filesize=5.1 K 2023-07-18 10:12:10,199 INFO [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~65 B/65, heapSize ~384 B/384, currentSize=0 B/0 for 66c0f03bc424a8048ec7ccacf1fe7bef in 108ms, sequenceid=6, compaction requested=false 2023-07-18 10:12:10,200 DEBUG [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 66c0f03bc424a8048ec7ccacf1fe7bef: 2023-07-18 10:12:10,202 DEBUG [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689675128965.66c0f03bc424a8048ec7ccacf1fe7bef.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:10,202 DEBUG [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 10:12:10,202 DEBUG [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testEmptyExportFileSystemState/66c0f03bc424a8048ec7ccacf1fe7bef/cf/b978502c580c451c9f8598dddfc368ef] hfiles 2023-07-18 10:12:10,202 DEBUG [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testEmptyExportFileSystemState/66c0f03bc424a8048ec7ccacf1fe7bef/cf/b978502c580c451c9f8598dddfc368ef for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:10,215 DEBUG [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689675128965.6b02a58b240dd6284579a47d3b8b917a. completed. 2023-07-18 10:12:10,215 DEBUG [rs(jenkins-hbase4.apache.org,37417,1689675027545)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689675128965.6b02a58b240dd6284579a47d3b8b917a. 2023-07-18 10:12:10,215 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 10:12:10,215 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 10:12:10,215 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:12:10,215 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-18 10:12:10,215 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37417,1689675027545' in zk 2023-07-18 10:12:10,217 DEBUG [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689675128965.66c0f03bc424a8048ec7ccacf1fe7bef. completed. 2023-07-18 10:12:10,217 DEBUG [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689675128965.66c0f03bc424a8048ec7ccacf1fe7bef. 2023-07-18 10:12:10,217 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 10:12:10,217 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 10:12:10,217 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:12:10,217 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-18 10:12:10,217 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43301,1689675027670' in zk 2023-07-18 10:12:10,217 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:12:10,217 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-18 10:12:10,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:12:10,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:12:10,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:12:10,218 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:12:10,218 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-18 10:12:10,219 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:12:10,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:12:10,219 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-18 10:12:10,219 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:12:10,220 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-18 10:12:10,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:12:10,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:10,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:12:10,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:12:10,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:12:10,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:12:10,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:10,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:12:10,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:12:10,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:12:10,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,37417,1689675027545': 2023-07-18 10:12:10,224 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37417,1689675027545' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-18 10:12:10,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:12:10,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:12:10,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:12:10,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:12:10,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:12:10,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:10,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:12:10,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:12:10,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:12:10,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:12:10,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:10,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:12:10,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:12:10,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:12:10,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,43301,1689675027670': 2023-07-18 10:12:10,227 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43301,1689675027670' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-18 10:12:10,227 INFO [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-18 10:12:10,227 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-18 10:12:10,227 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-18 10:12:10,227 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:10,228 INFO [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-18 10:12:10,229 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:10,229 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:10,229 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:10,229 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:10,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:10,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:12:10,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:12:10,229 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:12:10,229 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:10,229 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:12:10,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:10,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:10,230 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:12:10,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:12:10,230 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:12:10,230 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:12:10,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:12:10,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:12:10,230 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:10,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:10,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:10,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:10,231 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:12:10,231 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:12:10,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:10,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:10,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:12:10,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:12:10,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:12:10,231 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:12:10,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:10,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:10,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:12:10,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:12:10,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:12:10,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:12:10,233 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:12:10,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:10,233 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:12:10,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:12:10,234 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:12:10,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:12:10,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:12:10,237 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:12:10,237 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:12:10,237 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:12:10,237 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:10,237 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:12:10,237 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:12:10,237 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:12:10,237 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:12:10,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:12:10,237 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:12:10,237 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:12:10,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:12:10,237 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:12:10,237 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:10,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:12:10,237 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:12:10,237 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:12:10,239 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:12:10,239 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:10,239 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:12:10,239 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:12:10,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:12:10,239 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-18 10:12:10,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:12:10,239 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:10,239 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:12:10,239 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-18 10:12:10,239 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:10,239 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:12:10,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:12:10,239 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:12:10,239 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:12:10,239 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:10,239 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:10,240 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230718047f34a3f31f435aa2038efa61f81ed1, hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202307186bb087920a9d4844bde0340618ce10ec] mob files 2023-07-18 10:12:10,240 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230718047f34a3f31f435aa2038efa61f81ed1 2023-07-18 10:12:10,240 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202307186bb087920a9d4844bde0340618ce10ec 2023-07-18 10:12:10,247 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:10,248 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:10,272 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:10,310 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-18 10:12:10,310 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:10,310 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:10,310 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689675130031Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1689675130247 (+216 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1689675130247Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1689675130247Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1689675130251 (+4 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1689675130263 (+12 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689675130310 (+47 ms) 2023-07-18 10:12:10,316 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-18 10:12:10,317 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 284 msec 2023-07-18 10:12:10,336 DEBUG [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 10:12:10,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-18 10:12:10,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-18 10:12:10,337 INFO [Listener at jenkins-hbase4.apache.org/34477] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/export-test/export-1689675130337 2023-07-18 10:12:10,337 INFO [Listener at jenkins-hbase4.apache.org/34477] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:44811, tgtDir=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/export-test/export-1689675130337, rawTgtDir=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/export-test/export-1689675130337, srcFsUri=hdfs://localhost:44811, srcDir=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427 2023-07-18 10:12:10,363 DEBUG [Listener at jenkins-hbase4.apache.org/34477] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44811, inputRoot=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427 2023-07-18 10:12:10,363 DEBUG [Listener at jenkins-hbase4.apache.org/34477] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1591280011_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/export-test/export-1689675130337, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/export-test/export-1689675130337/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:10,363 INFO [Listener at jenkins-hbase4.apache.org/34477] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44811, inputRoot=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427, snapshotDir=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-18 10:12:10,374 INFO [Listener at jenkins-hbase4.apache.org/34477] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/export-test/export-1689675130337/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:10,433 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-18 10:12:10,434 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-18 10:12:10,434 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-18 10:12:10,435 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-18 10:12:10,435 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-18 10:12:10,436 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-18 10:12:10,436 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-18 10:12:10,534 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c329d283-1f43-4a99-3860-7ed90b9830ca/hadoop-5853152390364445613.jar 2023-07-18 10:12:10,534 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-18 10:12:10,535 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-18 10:12:10,535 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-18 10:12:10,536 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-18 10:12:10,536 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-18 10:12:10,537 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-18 10:12:10,537 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-18 10:12:10,538 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-18 10:12:10,538 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-18 10:12:10,539 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-18 10:12:10,540 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-18 10:12:10,540 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-18 10:12:10,541 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-18 10:12:10,541 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-18 10:12:10,542 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-18 10:12:10,542 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-18 10:12:10,543 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 10:12:10,543 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 10:12:10,544 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 10:12:10,544 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 10:12:10,544 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 10:12:10,545 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 10:12:10,546 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 10:12:11,301 WARN [Listener at jenkins-hbase4.apache.org/34477] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-18 10:12:11,304 INFO [Listener at jenkins-hbase4.apache.org/34477] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-18 10:12:12,683 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 10:12:12,683 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 10:12:12,687 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689675035640_0005_000001 (auth:SIMPLE) 2023-07-18 10:12:12,754 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689675035640_0006_000001 (auth:SIMPLE) 2023-07-18 10:12:13,969 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-18 10:12:19,275 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689675035640_0006_000001 (auth:SIMPLE) 2023-07-18 10:12:22,536 INFO [Listener at jenkins-hbase4.apache.org/34477] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-18 10:12:22,540 INFO [Listener at jenkins-hbase4.apache.org/34477] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-18 10:12:22,548 INFO [Listener at jenkins-hbase4.apache.org/34477] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:22,548 INFO [Listener at jenkins-hbase4.apache.org/34477] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-18 10:12:22,548 INFO [Listener at jenkins-hbase4.apache.org/34477] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-18 10:12:22,548 DEBUG [Listener at jenkins-hbase4.apache.org/34477] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_307542026_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:22,549 DEBUG [Listener at jenkins-hbase4.apache.org/34477] snapshot.TestExportSnapshot(367): hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-18 10:12:22,549 DEBUG [Listener at jenkins-hbase4.apache.org/34477] snapshot.TestExportSnapshot(367): hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-18 10:12:22,549 DEBUG [Listener at jenkins-hbase4.apache.org/34477] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_307542026_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/export-test/export-1689675130337/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/export-test/export-1689675130337/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:22,550 DEBUG [Listener at jenkins-hbase4.apache.org/34477] snapshot.TestExportSnapshot(367): hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/export-test/export-1689675130337/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-18 10:12:22,550 DEBUG [Listener at jenkins-hbase4.apache.org/34477] snapshot.TestExportSnapshot(367): hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/export-test/export-1689675130337/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-18 10:12:22,555 INFO [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-18 10:12:22,556 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-07-18 10:12:22,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-18 10:12:22,561 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689675142561"}]},"ts":"1689675142561"} 2023-07-18 10:12:22,562 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-18 10:12:22,565 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-18 10:12:22,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-18 10:12:22,567 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=66c0f03bc424a8048ec7ccacf1fe7bef, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6b02a58b240dd6284579a47d3b8b917a, UNASSIGN}] 2023-07-18 10:12:22,569 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=66c0f03bc424a8048ec7ccacf1fe7bef, UNASSIGN 2023-07-18 10:12:22,570 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6b02a58b240dd6284579a47d3b8b917a, UNASSIGN 2023-07-18 10:12:22,570 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=66c0f03bc424a8048ec7ccacf1fe7bef, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:12:22,571 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689675128965.66c0f03bc424a8048ec7ccacf1fe7bef.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689675142570"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689675142570"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689675142570"}]},"ts":"1689675142570"} 2023-07-18 10:12:22,571 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=6b02a58b240dd6284579a47d3b8b917a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:12:22,571 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689675128965.6b02a58b240dd6284579a47d3b8b917a.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689675142571"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689675142571"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689675142571"}]},"ts":"1689675142571"} 2023-07-18 10:12:22,573 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure 66c0f03bc424a8048ec7ccacf1fe7bef, server=jenkins-hbase4.apache.org,43301,1689675027670}] 2023-07-18 10:12:22,573 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure 6b02a58b240dd6284579a47d3b8b917a, server=jenkins-hbase4.apache.org,37417,1689675027545}] 2023-07-18 10:12:22,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-18 10:12:22,725 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 66c0f03bc424a8048ec7ccacf1fe7bef 2023-07-18 10:12:22,725 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 66c0f03bc424a8048ec7ccacf1fe7bef, disabling compactions & flushes 2023-07-18 10:12:22,726 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689675128965.66c0f03bc424a8048ec7ccacf1fe7bef. 2023-07-18 10:12:22,726 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689675128965.66c0f03bc424a8048ec7ccacf1fe7bef. 2023-07-18 10:12:22,726 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689675128965.66c0f03bc424a8048ec7ccacf1fe7bef. after waiting 0 ms 2023-07-18 10:12:22,726 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689675128965.66c0f03bc424a8048ec7ccacf1fe7bef. 2023-07-18 10:12:22,726 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 6b02a58b240dd6284579a47d3b8b917a 2023-07-18 10:12:22,727 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6b02a58b240dd6284579a47d3b8b917a, disabling compactions & flushes 2023-07-18 10:12:22,728 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689675128965.6b02a58b240dd6284579a47d3b8b917a. 2023-07-18 10:12:22,728 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689675128965.6b02a58b240dd6284579a47d3b8b917a. 2023-07-18 10:12:22,728 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689675128965.6b02a58b240dd6284579a47d3b8b917a. after waiting 0 ms 2023-07-18 10:12:22,731 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689675128965.6b02a58b240dd6284579a47d3b8b917a. 2023-07-18 10:12:22,753 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testEmptyExportFileSystemState/6b02a58b240dd6284579a47d3b8b917a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-18 10:12:22,753 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testEmptyExportFileSystemState/66c0f03bc424a8048ec7ccacf1fe7bef/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-18 10:12:22,754 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 10:12:22,754 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 10:12:22,755 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689675128965.6b02a58b240dd6284579a47d3b8b917a. 2023-07-18 10:12:22,756 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689675128965.66c0f03bc424a8048ec7ccacf1fe7bef. 2023-07-18 10:12:22,756 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 66c0f03bc424a8048ec7ccacf1fe7bef: 2023-07-18 10:12:22,756 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6b02a58b240dd6284579a47d3b8b917a: 2023-07-18 10:12:22,758 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 6b02a58b240dd6284579a47d3b8b917a 2023-07-18 10:12:22,758 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=6b02a58b240dd6284579a47d3b8b917a, regionState=CLOSED 2023-07-18 10:12:22,759 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689675128965.6b02a58b240dd6284579a47d3b8b917a.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689675142758"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689675142758"}]},"ts":"1689675142758"} 2023-07-18 10:12:22,759 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 66c0f03bc424a8048ec7ccacf1fe7bef 2023-07-18 10:12:22,759 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=66c0f03bc424a8048ec7ccacf1fe7bef, regionState=CLOSED 2023-07-18 10:12:22,759 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689675128965.66c0f03bc424a8048ec7ccacf1fe7bef.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689675142759"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689675142759"}]},"ts":"1689675142759"} 2023-07-18 10:12:22,762 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=101 2023-07-18 10:12:22,762 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure 6b02a58b240dd6284579a47d3b8b917a, server=jenkins-hbase4.apache.org,37417,1689675027545 in 187 msec 2023-07-18 10:12:22,763 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=100 2023-07-18 10:12:22,763 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure 66c0f03bc424a8048ec7ccacf1fe7bef, server=jenkins-hbase4.apache.org,43301,1689675027670 in 188 msec 2023-07-18 10:12:22,763 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6b02a58b240dd6284579a47d3b8b917a, UNASSIGN in 195 msec 2023-07-18 10:12:22,765 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=100, resume processing ppid=99 2023-07-18 10:12:22,765 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=66c0f03bc424a8048ec7ccacf1fe7bef, UNASSIGN in 196 msec 2023-07-18 10:12:22,765 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689675142765"}]},"ts":"1689675142765"} 2023-07-18 10:12:22,767 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-18 10:12:22,768 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-18 10:12:22,770 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 213 msec 2023-07-18 10:12:22,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-18 10:12:22,868 INFO [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-18 10:12:22,869 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-07-18 10:12:22,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-18 10:12:22,873 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-18 10:12:22,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-18 10:12:22,874 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-18 10:12:22,878 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43301] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-18 10:12:22,878 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testEmptyExportFileSystemState/6b02a58b240dd6284579a47d3b8b917a 2023-07-18 10:12:22,878 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testEmptyExportFileSystemState/66c0f03bc424a8048ec7ccacf1fe7bef 2023-07-18 10:12:22,881 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testEmptyExportFileSystemState/6b02a58b240dd6284579a47d3b8b917a/cf, FileablePath, hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testEmptyExportFileSystemState/6b02a58b240dd6284579a47d3b8b917a/recovered.edits] 2023-07-18 10:12:22,881 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testEmptyExportFileSystemState/66c0f03bc424a8048ec7ccacf1fe7bef/cf, FileablePath, hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testEmptyExportFileSystemState/66c0f03bc424a8048ec7ccacf1fe7bef/recovered.edits] 2023-07-18 10:12:22,882 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-18 10:12:22,882 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-18 10:12:22,882 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-18 10:12:22,882 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-18 10:12:22,883 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-18 10:12:22,883 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-18 10:12:22,883 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-18 10:12:22,884 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-18 10:12:22,884 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-18 10:12:22,884 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data null 2023-07-18 10:12:22,884 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-18 10:12:22,884 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:12:22,884 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-18 10:12:22,884 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:12:22,884 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:12:22,884 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:12:22,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-18 10:12:22,886 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testEmptyExportFileSystemState/6b02a58b240dd6284579a47d3b8b917a/cf/370859ce4dda41038bc1252e7921d612 to hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/archive/data/default/testtb-testEmptyExportFileSystemState/6b02a58b240dd6284579a47d3b8b917a/cf/370859ce4dda41038bc1252e7921d612 2023-07-18 10:12:22,886 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testEmptyExportFileSystemState/66c0f03bc424a8048ec7ccacf1fe7bef/cf/b978502c580c451c9f8598dddfc368ef to hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/archive/data/default/testtb-testEmptyExportFileSystemState/66c0f03bc424a8048ec7ccacf1fe7bef/cf/b978502c580c451c9f8598dddfc368ef 2023-07-18 10:12:22,890 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testEmptyExportFileSystemState/6b02a58b240dd6284579a47d3b8b917a/recovered.edits/9.seqid to hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/archive/data/default/testtb-testEmptyExportFileSystemState/6b02a58b240dd6284579a47d3b8b917a/recovered.edits/9.seqid 2023-07-18 10:12:22,890 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testEmptyExportFileSystemState/6b02a58b240dd6284579a47d3b8b917a 2023-07-18 10:12:22,890 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testEmptyExportFileSystemState/66c0f03bc424a8048ec7ccacf1fe7bef/recovered.edits/9.seqid to hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/archive/data/default/testtb-testEmptyExportFileSystemState/66c0f03bc424a8048ec7ccacf1fe7bef/recovered.edits/9.seqid 2023-07-18 10:12:22,891 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testEmptyExportFileSystemState/66c0f03bc424a8048ec7ccacf1fe7bef 2023-07-18 10:12:22,891 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-18 10:12:22,891 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-18 10:12:22,892 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-07-18 10:12:22,897 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230718047f34a3f31f435aa2038efa61f81ed1 to hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230718047f34a3f31f435aa2038efa61f81ed1 2023-07-18 10:12:22,899 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202307186bb087920a9d4844bde0340618ce10ec to hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202307186bb087920a9d4844bde0340618ce10ec 2023-07-18 10:12:22,899 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-18 10:12:22,902 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-18 10:12:22,905 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-18 10:12:22,908 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-18 10:12:22,909 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-18 10:12:22,909 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-18 10:12:22,909 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1689675128965.66c0f03bc424a8048ec7ccacf1fe7bef.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689675142909"}]},"ts":"9223372036854775807"} 2023-07-18 10:12:22,910 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1689675128965.6b02a58b240dd6284579a47d3b8b917a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689675142909"}]},"ts":"9223372036854775807"} 2023-07-18 10:12:22,912 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-18 10:12:22,912 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 66c0f03bc424a8048ec7ccacf1fe7bef, NAME => 'testtb-testEmptyExportFileSystemState,,1689675128965.66c0f03bc424a8048ec7ccacf1fe7bef.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 6b02a58b240dd6284579a47d3b8b917a, NAME => 'testtb-testEmptyExportFileSystemState,1,1689675128965.6b02a58b240dd6284579a47d3b8b917a.', STARTKEY => '1', ENDKEY => ''}] 2023-07-18 10:12:22,912 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-18 10:12:22,912 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689675142912"}]},"ts":"9223372036854775807"} 2023-07-18 10:12:22,914 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-18 10:12:22,916 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-18 10:12:22,919 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 47 msec 2023-07-18 10:12:22,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-18 10:12:22,987 INFO [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-18 10:12:22,995 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-18 10:12:22,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:22,999 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-18 10:12:23,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-18 10:12:23,039 INFO [Listener at jenkins-hbase4.apache.org/34477] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=758 (was 757) Potentially hanging thread: hconnection-0x36ae74de-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1591280011_17 at /127.0.0.1:35420 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1988502388) connection to jenkins-hbase4.apache.org/172.31.14.131:34851 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-961725640_1 at /127.0.0.1:60132 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x36ae74de-shared-pool-37 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4788 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x36ae74de-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_307542026_17 at /127.0.0.1:60158 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x36ae74de-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_307542026_17 at /127.0.0.1:60016 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=905 (was 906), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=590 (was 488) - SystemLoadAverage LEAK? -, ProcessCount=184 (was 184), AvailableMemoryMB=1688 (was 2315) 2023-07-18 10:12:23,039 WARN [Listener at jenkins-hbase4.apache.org/34477] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-07-18 10:12:23,068 INFO [Listener at jenkins-hbase4.apache.org/34477] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=758, OpenFileDescriptor=905, MaxFileDescriptor=60000, SystemLoadAverage=590, ProcessCount=184, AvailableMemoryMB=1687 2023-07-18 10:12:23,068 WARN [Listener at jenkins-hbase4.apache.org/34477] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-07-18 10:12:23,070 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-18 10:12:23,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:23,075 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-18 10:12:23,075 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-18 10:12:23,075 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-18 10:12:23,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-18 10:12:23,078 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/00412595edf6ace19ac04ba736f60bc3 2023-07-18 10:12:23,078 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/13c2e8f0d4f3d80425ecfa834f0dfedc 2023-07-18 10:12:23,079 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/00412595edf6ace19ac04ba736f60bc3 empty. 2023-07-18 10:12:23,079 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/00412595edf6ace19ac04ba736f60bc3 2023-07-18 10:12:23,082 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/13c2e8f0d4f3d80425ecfa834f0dfedc empty. 2023-07-18 10:12:23,082 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/13c2e8f0d4f3d80425ecfa834f0dfedc 2023-07-18 10:12:23,082 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-18 10:12:23,100 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-18 10:12:23,102 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 00412595edf6ace19ac04ba736f60bc3, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689675143070.00412595edf6ace19ac04ba736f60bc3.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp 2023-07-18 10:12:23,104 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 13c2e8f0d4f3d80425ecfa834f0dfedc, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689675143070.13c2e8f0d4f3d80425ecfa834f0dfedc.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp 2023-07-18 10:12:23,132 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689675143070.00412595edf6ace19ac04ba736f60bc3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 10:12:23,132 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 00412595edf6ace19ac04ba736f60bc3, disabling compactions & flushes 2023-07-18 10:12:23,132 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689675143070.13c2e8f0d4f3d80425ecfa834f0dfedc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 10:12:23,132 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689675143070.00412595edf6ace19ac04ba736f60bc3. 2023-07-18 10:12:23,132 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 13c2e8f0d4f3d80425ecfa834f0dfedc, disabling compactions & flushes 2023-07-18 10:12:23,132 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689675143070.00412595edf6ace19ac04ba736f60bc3. 2023-07-18 10:12:23,132 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689675143070.00412595edf6ace19ac04ba736f60bc3. after waiting 0 ms 2023-07-18 10:12:23,132 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689675143070.00412595edf6ace19ac04ba736f60bc3. 2023-07-18 10:12:23,132 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689675143070.00412595edf6ace19ac04ba736f60bc3. 2023-07-18 10:12:23,132 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 00412595edf6ace19ac04ba736f60bc3: 2023-07-18 10:12:23,132 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689675143070.13c2e8f0d4f3d80425ecfa834f0dfedc. 2023-07-18 10:12:23,132 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689675143070.13c2e8f0d4f3d80425ecfa834f0dfedc. 2023-07-18 10:12:23,132 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689675143070.13c2e8f0d4f3d80425ecfa834f0dfedc. after waiting 0 ms 2023-07-18 10:12:23,132 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689675143070.13c2e8f0d4f3d80425ecfa834f0dfedc. 2023-07-18 10:12:23,132 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689675143070.13c2e8f0d4f3d80425ecfa834f0dfedc. 2023-07-18 10:12:23,132 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 13c2e8f0d4f3d80425ecfa834f0dfedc: 2023-07-18 10:12:23,137 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-18 10:12:23,138 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689675143070.00412595edf6ace19ac04ba736f60bc3.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689675143137"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689675143137"}]},"ts":"1689675143137"} 2023-07-18 10:12:23,138 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689675143070.13c2e8f0d4f3d80425ecfa834f0dfedc.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689675143137"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689675143137"}]},"ts":"1689675143137"} 2023-07-18 10:12:23,140 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-18 10:12:23,141 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-18 10:12:23,141 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689675143141"}]},"ts":"1689675143141"} 2023-07-18 10:12:23,143 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-18 10:12:23,146 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 10:12:23,148 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 10:12:23,148 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 10:12:23,148 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-18 10:12:23,148 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 10:12:23,149 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=00412595edf6ace19ac04ba736f60bc3, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=13c2e8f0d4f3d80425ecfa834f0dfedc, ASSIGN}] 2023-07-18 10:12:23,152 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=13c2e8f0d4f3d80425ecfa834f0dfedc, ASSIGN 2023-07-18 10:12:23,152 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=00412595edf6ace19ac04ba736f60bc3, ASSIGN 2023-07-18 10:12:23,153 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=13c2e8f0d4f3d80425ecfa834f0dfedc, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43301,1689675027670; forceNewPlan=false, retain=false 2023-07-18 10:12:23,153 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=00412595edf6ace19ac04ba736f60bc3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39709,1689675027617; forceNewPlan=false, retain=false 2023-07-18 10:12:23,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-18 10:12:23,303 INFO [jenkins-hbase4:38235] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-18 10:12:23,307 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=13c2e8f0d4f3d80425ecfa834f0dfedc, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:12:23,307 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=00412595edf6ace19ac04ba736f60bc3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:12:23,308 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689675143070.00412595edf6ace19ac04ba736f60bc3.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689675143307"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689675143307"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689675143307"}]},"ts":"1689675143307"} 2023-07-18 10:12:23,308 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689675143070.13c2e8f0d4f3d80425ecfa834f0dfedc.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689675143307"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689675143307"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689675143307"}]},"ts":"1689675143307"} 2023-07-18 10:12:23,310 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=106, state=RUNNABLE; OpenRegionProcedure 00412595edf6ace19ac04ba736f60bc3, server=jenkins-hbase4.apache.org,39709,1689675027617}] 2023-07-18 10:12:23,311 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure 13c2e8f0d4f3d80425ecfa834f0dfedc, server=jenkins-hbase4.apache.org,43301,1689675027670}] 2023-07-18 10:12:23,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-18 10:12:23,470 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1689675143070.13c2e8f0d4f3d80425ecfa834f0dfedc. 2023-07-18 10:12:23,470 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 13c2e8f0d4f3d80425ecfa834f0dfedc, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689675143070.13c2e8f0d4f3d80425ecfa834f0dfedc.', STARTKEY => '1', ENDKEY => ''} 2023-07-18 10:12:23,470 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1689675143070.00412595edf6ace19ac04ba736f60bc3. 2023-07-18 10:12:23,470 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1689675143070.13c2e8f0d4f3d80425ecfa834f0dfedc. service=AccessControlService 2023-07-18 10:12:23,470 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 00412595edf6ace19ac04ba736f60bc3, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689675143070.00412595edf6ace19ac04ba736f60bc3.', STARTKEY => '', ENDKEY => '1'} 2023-07-18 10:12:23,471 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 10:12:23,471 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1689675143070.00412595edf6ace19ac04ba736f60bc3. service=AccessControlService 2023-07-18 10:12:23,471 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 13c2e8f0d4f3d80425ecfa834f0dfedc 2023-07-18 10:12:23,471 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689675143070.13c2e8f0d4f3d80425ecfa834f0dfedc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 10:12:23,471 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 10:12:23,471 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 13c2e8f0d4f3d80425ecfa834f0dfedc 2023-07-18 10:12:23,471 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 00412595edf6ace19ac04ba736f60bc3 2023-07-18 10:12:23,471 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 13c2e8f0d4f3d80425ecfa834f0dfedc 2023-07-18 10:12:23,471 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689675143070.00412595edf6ace19ac04ba736f60bc3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 10:12:23,471 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 00412595edf6ace19ac04ba736f60bc3 2023-07-18 10:12:23,471 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 00412595edf6ace19ac04ba736f60bc3 2023-07-18 10:12:23,474 INFO [StoreOpener-13c2e8f0d4f3d80425ecfa834f0dfedc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 13c2e8f0d4f3d80425ecfa834f0dfedc 2023-07-18 10:12:23,475 INFO [StoreOpener-00412595edf6ace19ac04ba736f60bc3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 00412595edf6ace19ac04ba736f60bc3 2023-07-18 10:12:23,476 DEBUG [StoreOpener-13c2e8f0d4f3d80425ecfa834f0dfedc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemStateWithSkipTmp/13c2e8f0d4f3d80425ecfa834f0dfedc/cf 2023-07-18 10:12:23,476 DEBUG [StoreOpener-13c2e8f0d4f3d80425ecfa834f0dfedc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemStateWithSkipTmp/13c2e8f0d4f3d80425ecfa834f0dfedc/cf 2023-07-18 10:12:23,476 DEBUG [StoreOpener-00412595edf6ace19ac04ba736f60bc3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemStateWithSkipTmp/00412595edf6ace19ac04ba736f60bc3/cf 2023-07-18 10:12:23,476 DEBUG [StoreOpener-00412595edf6ace19ac04ba736f60bc3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemStateWithSkipTmp/00412595edf6ace19ac04ba736f60bc3/cf 2023-07-18 10:12:23,476 INFO [StoreOpener-13c2e8f0d4f3d80425ecfa834f0dfedc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 13c2e8f0d4f3d80425ecfa834f0dfedc columnFamilyName cf 2023-07-18 10:12:23,476 INFO [StoreOpener-00412595edf6ace19ac04ba736f60bc3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 00412595edf6ace19ac04ba736f60bc3 columnFamilyName cf 2023-07-18 10:12:23,478 INFO [StoreOpener-13c2e8f0d4f3d80425ecfa834f0dfedc-1] regionserver.HStore(310): Store=13c2e8f0d4f3d80425ecfa834f0dfedc/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 10:12:23,478 INFO [StoreOpener-00412595edf6ace19ac04ba736f60bc3-1] regionserver.HStore(310): Store=00412595edf6ace19ac04ba736f60bc3/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 10:12:23,479 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemStateWithSkipTmp/13c2e8f0d4f3d80425ecfa834f0dfedc 2023-07-18 10:12:23,479 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemStateWithSkipTmp/00412595edf6ace19ac04ba736f60bc3 2023-07-18 10:12:23,479 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemStateWithSkipTmp/13c2e8f0d4f3d80425ecfa834f0dfedc 2023-07-18 10:12:23,479 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemStateWithSkipTmp/00412595edf6ace19ac04ba736f60bc3 2023-07-18 10:12:23,482 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 13c2e8f0d4f3d80425ecfa834f0dfedc 2023-07-18 10:12:23,482 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 00412595edf6ace19ac04ba736f60bc3 2023-07-18 10:12:23,484 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemStateWithSkipTmp/13c2e8f0d4f3d80425ecfa834f0dfedc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 10:12:23,484 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemStateWithSkipTmp/00412595edf6ace19ac04ba736f60bc3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 10:12:23,485 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 13c2e8f0d4f3d80425ecfa834f0dfedc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65133790, jitterRate=-0.029430896043777466}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 10:12:23,485 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 13c2e8f0d4f3d80425ecfa834f0dfedc: 2023-07-18 10:12:23,485 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 00412595edf6ace19ac04ba736f60bc3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65490169, jitterRate=-0.024120435118675232}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 10:12:23,485 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 00412595edf6ace19ac04ba736f60bc3: 2023-07-18 10:12:23,486 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1689675143070.13c2e8f0d4f3d80425ecfa834f0dfedc., pid=109, masterSystemTime=1689675143463 2023-07-18 10:12:23,486 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1689675143070.00412595edf6ace19ac04ba736f60bc3., pid=108, masterSystemTime=1689675143463 2023-07-18 10:12:23,487 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1689675143070.13c2e8f0d4f3d80425ecfa834f0dfedc. 2023-07-18 10:12:23,487 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1689675143070.13c2e8f0d4f3d80425ecfa834f0dfedc. 2023-07-18 10:12:23,488 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=13c2e8f0d4f3d80425ecfa834f0dfedc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:12:23,488 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1689675143070.00412595edf6ace19ac04ba736f60bc3. 2023-07-18 10:12:23,488 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1689675143070.00412595edf6ace19ac04ba736f60bc3. 2023-07-18 10:12:23,488 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689675143070.13c2e8f0d4f3d80425ecfa834f0dfedc.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689675143488"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689675143488"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689675143488"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689675143488"}]},"ts":"1689675143488"} 2023-07-18 10:12:23,489 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=00412595edf6ace19ac04ba736f60bc3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:12:23,490 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689675143070.00412595edf6ace19ac04ba736f60bc3.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689675143489"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689675143489"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689675143489"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689675143489"}]},"ts":"1689675143489"} 2023-07-18 10:12:23,491 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=107 2023-07-18 10:12:23,491 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure 13c2e8f0d4f3d80425ecfa834f0dfedc, server=jenkins-hbase4.apache.org,43301,1689675027670 in 179 msec 2023-07-18 10:12:23,492 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=106 2023-07-18 10:12:23,492 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=13c2e8f0d4f3d80425ecfa834f0dfedc, ASSIGN in 342 msec 2023-07-18 10:12:23,493 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=106, state=SUCCESS; OpenRegionProcedure 00412595edf6ace19ac04ba736f60bc3, server=jenkins-hbase4.apache.org,39709,1689675027617 in 181 msec 2023-07-18 10:12:23,494 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=106, resume processing ppid=105 2023-07-18 10:12:23,494 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=00412595edf6ace19ac04ba736f60bc3, ASSIGN in 344 msec 2023-07-18 10:12:23,495 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-18 10:12:23,495 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689675143495"}]},"ts":"1689675143495"} 2023-07-18 10:12:23,497 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-18 10:12:23,500 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-18 10:12:23,500 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-18 10:12:23,502 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43301] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-18 10:12:23,504 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:12:23,504 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:12:23,504 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:12:23,504 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:12:23,505 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-18 10:12:23,505 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-18 10:12:23,506 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-18 10:12:23,506 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-18 10:12:23,508 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 434 msec 2023-07-18 10:12:23,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-18 10:12:23,680 INFO [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-18 10:12:23,682 DEBUG [Listener at jenkins-hbase4.apache.org/34477] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:23,683 DEBUG [Listener at jenkins-hbase4.apache.org/34477] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689675143070.00412595edf6ace19ac04ba736f60bc3. 2023-07-18 10:12:23,686 INFO [Listener at jenkins-hbase4.apache.org/34477] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 10:12:23,710 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-18 10:12:23,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689675143710 (current time:1689675143710). 2023-07-18 10:12:23,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-18 10:12:23,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] zookeeper.ReadOnlyZKClient(139): Connect 0x6d1df3c6 to 127.0.0.1:60990 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 10:12:23,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@14b8d0fc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 10:12:23,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 10:12:23,727 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52270, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 10:12:23,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6d1df3c6 to 127.0.0.1:60990 2023-07-18 10:12:23,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 10:12:23,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] zookeeper.ReadOnlyZKClient(139): Connect 0x222d1d8f to 127.0.0.1:60990 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 10:12:23,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@202c59cf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 10:12:23,743 DEBUG [hconnection-0x72414206-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 10:12:23,747 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52278, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 10:12:23,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 10:12:23,755 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47670, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 10:12:23,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x222d1d8f to 127.0.0.1:60990 2023-07-18 10:12:23,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 10:12:23,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-18 10:12:23,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-18 10:12:23,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-18 10:12:23,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-18 10:12:23,765 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-18 10:12:23,770 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689675743770 2023-07-18 10:12:23,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-18 10:12:23,770 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:23,772 DEBUG [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-18 10:12:23,772 DEBUG [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-18 10:12:23,774 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-18 10:12:23,774 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-18 10:12:23,775 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 12 msec 2023-07-18 10:12:23,776 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-18 10:12:23,777 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689675743777 2023-07-18 10:12:23,792 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:23,792 INFO [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-18 10:12:23,792 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:12:23,793 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-18 10:12:23,794 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-18 10:12:23,794 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:23,794 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:23,795 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:12:23,796 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:12:23,796 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:12:23,796 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:12:23,796 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:12:23,796 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:12:23,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:12:23,796 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:12:23,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:12:23,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:12:23,796 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:12:23,796 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:12:23,799 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:12:23,799 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-18 10:12:23,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:23,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:23,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:23,799 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:23,799 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:23,799 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:23,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-18 10:12:23,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-18 10:12:23,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:23,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-18 10:12:23,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:23,800 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-18 10:12:23,800 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-18 10:12:23,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:23,800 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:23,800 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-18 10:12:23,800 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-18 10:12:23,800 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:23,801 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:12:23,801 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-18 10:12:23,802 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:12:23,801 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:23,803 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-18 10:12:23,803 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-18 10:12:23,803 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37417,1689675027545' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-18 10:12:23,802 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-18 10:12:23,803 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-18 10:12:23,804 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:12:23,804 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-18 10:12:23,805 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-18 10:12:23,805 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-18 10:12:23,805 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43301,1689675027670' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-18 10:12:23,805 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39709,1689675027617' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-18 10:12:23,808 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:23,811 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:23,811 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:23,811 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 10:12:23,811 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:23,811 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:12:23,811 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:12:23,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:12:23,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:12:23,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:12:23,811 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:23,811 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:23,811 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 10:12:23,811 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 10:12:23,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:12:23,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:12:23,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:23,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:12:23,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:12:23,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:12:23,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:12:23,814 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43301,1689675027670' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-18 10:12:23,814 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2d8f5cf2[Count = 1] remaining members to acquire global barrier 2023-07-18 10:12:23,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:12:23,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:12:23,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:12:23,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:12:23,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:12:23,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:23,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:12:23,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:12:23,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:12:23,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:12:23,816 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39709,1689675027617' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-18 10:12:23,816 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2d8f5cf2[Count = 0] remaining members to acquire global barrier 2023-07-18 10:12:23,816 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-18 10:12:23,816 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:23,817 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:23,817 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:23,817 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:23,817 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:23,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:23,817 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:23,818 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-18 10:12:23,817 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:12:23,817 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:23,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:23,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:23,818 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-18 10:12:23,818 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-18 10:12:23,818 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,37417,1689675027545' in zk 2023-07-18 10:12:23,818 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:12:23,818 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-18 10:12:23,819 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-18 10:12:23,819 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 10:12:23,819 DEBUG [rs(jenkins-hbase4.apache.org,39709,1689675027617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689675143070.00412595edf6ace19ac04ba736f60bc3. 2023-07-18 10:12:23,819 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 10:12:23,819 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:12:23,819 DEBUG [rs(jenkins-hbase4.apache.org,39709,1689675027617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689675143070.00412595edf6ace19ac04ba736f60bc3. started... 2023-07-18 10:12:23,820 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-18 10:12:23,820 DEBUG [rs(jenkins-hbase4.apache.org,39709,1689675027617)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 00412595edf6ace19ac04ba736f60bc3: 2023-07-18 10:12:23,820 DEBUG [rs(jenkins-hbase4.apache.org,39709,1689675027617)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689675143070.00412595edf6ace19ac04ba736f60bc3.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:23,820 DEBUG [rs(jenkins-hbase4.apache.org,39709,1689675027617)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 10:12:23,820 DEBUG [rs(jenkins-hbase4.apache.org,39709,1689675027617)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-18 10:12:23,821 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-18 10:12:23,826 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 10:12:23,826 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 10:12:23,826 DEBUG [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689675143070.13c2e8f0d4f3d80425ecfa834f0dfedc. 2023-07-18 10:12:23,826 DEBUG [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689675143070.13c2e8f0d4f3d80425ecfa834f0dfedc. started... 2023-07-18 10:12:23,828 DEBUG [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 13c2e8f0d4f3d80425ecfa834f0dfedc: 2023-07-18 10:12:23,828 DEBUG [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689675143070.13c2e8f0d4f3d80425ecfa834f0dfedc.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:23,828 DEBUG [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 10:12:23,828 DEBUG [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-18 10:12:23,839 DEBUG [rs(jenkins-hbase4.apache.org,39709,1689675027617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689675143070.00412595edf6ace19ac04ba736f60bc3. completed. 2023-07-18 10:12:23,839 DEBUG [rs(jenkins-hbase4.apache.org,39709,1689675027617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689675143070.00412595edf6ace19ac04ba736f60bc3. 2023-07-18 10:12:23,839 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 10:12:23,840 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 10:12:23,840 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:12:23,840 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-18 10:12:23,840 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,39709,1689675027617' in zk 2023-07-18 10:12:23,841 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:12:23,841 DEBUG [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689675143070.13c2e8f0d4f3d80425ecfa834f0dfedc. completed. 2023-07-18 10:12:23,841 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-18 10:12:23,841 DEBUG [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689675143070.13c2e8f0d4f3d80425ecfa834f0dfedc. 2023-07-18 10:12:23,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:12:23,842 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 10:12:23,842 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 10:12:23,841 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:12:23,842 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:12:23,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:12:23,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:12:23,843 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-18 10:12:23,843 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,43301,1689675027670' in zk 2023-07-18 10:12:23,842 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-18 10:12:23,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:12:23,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:12:23,848 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:12:23,848 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-18 10:12:23,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:23,848 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:12:23,848 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-18 10:12:23,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:12:23,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:12:23,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:12:23,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:12:23,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:23,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:12:23,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:12:23,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:12:23,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,39709,1689675027617': 2023-07-18 10:12:23,852 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39709,1689675027617' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-18 10:12:23,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:12:23,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:12:23,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:12:23,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:12:23,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:12:23,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:23,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:12:23,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:12:23,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:12:23,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:12:23,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:23,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:12:23,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:12:23,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:12:23,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,43301,1689675027670': 2023-07-18 10:12:23,855 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43301,1689675027670' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-18 10:12:23,855 INFO [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-18 10:12:23,855 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-18 10:12:23,855 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-18 10:12:23,855 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:23,855 INFO [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-18 10:12:23,856 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:23,856 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:23,856 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:23,857 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:23,856 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:23,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:23,856 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:12:23,856 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:12:23,856 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:23,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:23,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:23,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:12:23,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:12:23,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:23,857 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:12:23,857 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:12:23,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:23,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:12:23,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:12:23,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:12:23,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:12:23,857 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:12:23,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:23,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:12:23,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:12:23,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:12:23,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:23,858 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:12:23,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:23,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:23,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:12:23,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:23,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:12:23,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:12:23,859 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:12:23,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:12:23,860 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:12:23,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:12:23,860 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:12:23,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:23,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:12:23,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:12:23,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:12:23,863 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:12:23,863 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:23,863 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:12:23,863 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:12:23,863 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:12:23,863 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:12:23,863 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:12:23,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:12:23,863 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:23,863 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:23,864 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:12:23,864 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:23,863 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:12:23,864 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:23,864 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:12:23,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:12:23,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:12:23,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:12:23,864 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-18 10:12:23,864 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:12:23,864 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:12:23,864 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:12:23,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:12:23,865 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:23,865 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:12:23,865 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:12:23,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:12:23,865 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:12:23,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:12:23,865 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:12:23,865 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:12:23,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:12:23,865 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:23,865 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-18 10:12:23,865 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:23,872 DEBUG [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 10:12:23,872 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:23,873 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:23,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-18 10:12:23,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-18 10:12:23,873 DEBUG [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-18 10:12:23,888 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:23,906 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-18 10:12:23,906 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:23,906 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:23,906 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689675143770Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1689675143872 (+102 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689675143872Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689675143873 (+1 ms)Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689675143876 (+3 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689675143883 (+7 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689675143906 (+23 ms) 2023-07-18 10:12:23,909 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-18 10:12:23,910 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 137 msec 2023-07-18 10:12:23,912 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-18 10:12:24,074 DEBUG [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 10:12:24,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-18 10:12:24,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-18 10:12:24,077 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39709] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1689675143070.00412595edf6ace19ac04ba736f60bc3. with WAL disabled. Data may be lost in the event of a crash. 2023-07-18 10:12:24,078 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43301] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1689675143070.13c2e8f0d4f3d80425ecfa834f0dfedc. with WAL disabled. Data may be lost in the event of a crash. 2023-07-18 10:12:24,080 DEBUG [Listener at jenkins-hbase4.apache.org/34477] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:24,080 DEBUG [Listener at jenkins-hbase4.apache.org/34477] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689675143070.00412595edf6ace19ac04ba736f60bc3. 2023-07-18 10:12:24,080 INFO [Listener at jenkins-hbase4.apache.org/34477] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 10:12:24,089 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-18 10:12:24,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689675144089 (current time:1689675144089). 2023-07-18 10:12:24,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-18 10:12:24,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] zookeeper.ReadOnlyZKClient(139): Connect 0x5d5f8f08 to 127.0.0.1:60990 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 10:12:24,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@25f6a7d7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 10:12:24,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 10:12:24,103 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52280, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 10:12:24,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5d5f8f08 to 127.0.0.1:60990 2023-07-18 10:12:24,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 10:12:24,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] zookeeper.ReadOnlyZKClient(139): Connect 0x3298cecc to 127.0.0.1:60990 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 10:12:24,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@131e3058, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 10:12:24,151 DEBUG [hconnection-0x3c6e5f3-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 10:12:24,155 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52282, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 10:12:24,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 10:12:24,172 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47680, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 10:12:24,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3298cecc to 127.0.0.1:60990 2023-07-18 10:12:24,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 10:12:24,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-18 10:12:24,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-18 10:12:24,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-18 10:12:24,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-18 10:12:24,179 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-18 10:12:24,180 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689675744180 2023-07-18 10:12:24,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-18 10:12:24,180 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:24,182 DEBUG [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-18 10:12:24,182 DEBUG [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-18 10:12:24,183 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-18 10:12:24,184 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-18 10:12:24,185 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 6 msec 2023-07-18 10:12:24,185 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-18 10:12:24,186 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689675744186 2023-07-18 10:12:24,204 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:24,204 INFO [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-18 10:12:24,204 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:12:24,206 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-18 10:12:24,206 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-18 10:12:24,279 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:24,279 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:24,283 DEBUG [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 10:12:24,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-18 10:12:24,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-18 10:12:24,285 DEBUG [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-18 10:12:24,288 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:12:24,288 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:12:24,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:12:24,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:12:24,288 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:12:24,288 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:12:24,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:12:24,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:12:24,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:12:24,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:12:24,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:24,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:24,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:24,290 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:12:24,290 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:12:24,290 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:24,290 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:24,290 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:24,291 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:12:24,291 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-18 10:12:24,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-18 10:12:24,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:24,291 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-18 10:12:24,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-18 10:12:24,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:24,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-18 10:12:24,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:24,291 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-18 10:12:24,291 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:24,292 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-18 10:12:24,292 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-18 10:12:24,292 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:24,292 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:12:24,292 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:24,292 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-18 10:12:24,294 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-18 10:12:24,294 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-18 10:12:24,294 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:12:24,294 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 10:12:24,296 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-18 10:12:24,294 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-18 10:12:24,296 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43301,1689675027670' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-18 10:12:24,297 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-18 10:12:24,297 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-18 10:12:24,297 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37417,1689675027545' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-18 10:12:24,296 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-18 10:12:24,297 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39709,1689675027617' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-18 10:12:24,299 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:12:24,299 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:24,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:12:24,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:12:24,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:12:24,300 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:12:24,300 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:24,300 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:24,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:12:24,300 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:24,300 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 10:12:24,300 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:24,300 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 10:12:24,300 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:24,300 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 10:12:24,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:12:24,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:24,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:12:24,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:12:24,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:12:24,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:12:24,303 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43301,1689675027670' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-18 10:12:24,303 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6f06d7ae[Count = 1] remaining members to acquire global barrier 2023-07-18 10:12:24,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:12:24,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:12:24,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:12:24,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:12:24,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:12:24,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:24,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:12:24,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:12:24,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:12:24,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:12:24,307 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39709,1689675027617' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-18 10:12:24,307 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6f06d7ae[Count = 0] remaining members to acquire global barrier 2023-07-18 10:12:24,307 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-18 10:12:24,307 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:24,313 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:24,313 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:24,313 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:24,313 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:24,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:24,313 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:24,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:24,313 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:24,313 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-18 10:12:24,314 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:12:24,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:24,313 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-18 10:12:24,314 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-18 10:12:24,314 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-18 10:12:24,314 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,37417,1689675027545' in zk 2023-07-18 10:12:24,314 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:12:24,314 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-18 10:12:24,314 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 10:12:24,315 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 10:12:24,315 DEBUG [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689675143070.13c2e8f0d4f3d80425ecfa834f0dfedc. 2023-07-18 10:12:24,315 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 10:12:24,315 DEBUG [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689675143070.13c2e8f0d4f3d80425ecfa834f0dfedc. started... 2023-07-18 10:12:24,315 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 10:12:24,315 DEBUG [rs(jenkins-hbase4.apache.org,39709,1689675027617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689675143070.00412595edf6ace19ac04ba736f60bc3. 2023-07-18 10:12:24,315 DEBUG [rs(jenkins-hbase4.apache.org,39709,1689675027617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689675143070.00412595edf6ace19ac04ba736f60bc3. started... 2023-07-18 10:12:24,315 INFO [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 13c2e8f0d4f3d80425ecfa834f0dfedc 1/1 column families, dataSize=2.87 KB heapSize=6.44 KB 2023-07-18 10:12:24,316 INFO [rs(jenkins-hbase4.apache.org,39709,1689675027617)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 00412595edf6ace19ac04ba736f60bc3 1/1 column families, dataSize=400 B heapSize=1.09 KB 2023-07-18 10:12:24,318 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-18 10:12:24,318 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:12:24,318 DEBUG [member: 'jenkins-hbase4.apache.org,37417,1689675027545' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-18 10:12:24,364 INFO [rs(jenkins-hbase4.apache.org,39709,1689675027617)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230718108e0a0db84e4cbc85d71f60c62d79ff to hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230718108e0a0db84e4cbc85d71f60c62d79ff 2023-07-18 10:12:24,377 INFO [rs(jenkins-hbase4.apache.org,39709,1689675027617)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=400, hasBloomFilter=true, into tmp file hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemStateWithSkipTmp/00412595edf6ace19ac04ba736f60bc3/.tmp/cf/69e3554d98224cdf8c1561ff7dd6404b 2023-07-18 10:12:24,383 DEBUG [rs(jenkins-hbase4.apache.org,39709,1689675027617)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemStateWithSkipTmp/00412595edf6ace19ac04ba736f60bc3/.tmp/cf/69e3554d98224cdf8c1561ff7dd6404b as hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemStateWithSkipTmp/00412595edf6ace19ac04ba736f60bc3/cf/69e3554d98224cdf8c1561ff7dd6404b 2023-07-18 10:12:24,388 INFO [rs(jenkins-hbase4.apache.org,39709,1689675027617)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemStateWithSkipTmp/00412595edf6ace19ac04ba736f60bc3/cf/69e3554d98224cdf8c1561ff7dd6404b, entries=6, sequenceid=6, filesize=6.0 K 2023-07-18 10:12:24,389 INFO [rs(jenkins-hbase4.apache.org,39709,1689675027617)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~400 B/400, heapSize ~1.08 KB/1104, currentSize=0 B/0 for 00412595edf6ace19ac04ba736f60bc3 in 73ms, sequenceid=6, compaction requested=false 2023-07-18 10:12:24,398 DEBUG [rs(jenkins-hbase4.apache.org,39709,1689675027617)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 00412595edf6ace19ac04ba736f60bc3: 2023-07-18 10:12:24,399 DEBUG [rs(jenkins-hbase4.apache.org,39709,1689675027617)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689675143070.00412595edf6ace19ac04ba736f60bc3.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:24,399 DEBUG [rs(jenkins-hbase4.apache.org,39709,1689675027617)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 10:12:24,399 DEBUG [rs(jenkins-hbase4.apache.org,39709,1689675027617)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemStateWithSkipTmp/00412595edf6ace19ac04ba736f60bc3/cf/69e3554d98224cdf8c1561ff7dd6404b] hfiles 2023-07-18 10:12:24,399 DEBUG [rs(jenkins-hbase4.apache.org,39709,1689675027617)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemStateWithSkipTmp/00412595edf6ace19ac04ba736f60bc3/cf/69e3554d98224cdf8c1561ff7dd6404b for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:24,414 DEBUG [rs(jenkins-hbase4.apache.org,39709,1689675027617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689675143070.00412595edf6ace19ac04ba736f60bc3. completed. 2023-07-18 10:12:24,414 DEBUG [rs(jenkins-hbase4.apache.org,39709,1689675027617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689675143070.00412595edf6ace19ac04ba736f60bc3. 2023-07-18 10:12:24,414 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 10:12:24,414 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 10:12:24,414 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:12:24,414 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-18 10:12:24,414 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,39709,1689675027617' in zk 2023-07-18 10:12:24,416 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:12:24,416 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-18 10:12:24,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:12:24,416 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:12:24,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:12:24,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:12:24,416 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1689675027617' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-18 10:12:24,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:12:24,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:12:24,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:24,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:12:24,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:12:24,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:12:24,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:12:24,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:24,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:12:24,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:12:24,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,39709,1689675027617': 2023-07-18 10:12:24,423 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39709,1689675027617' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-18 10:12:24,485 DEBUG [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 10:12:24,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-18 10:12:24,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-18 10:12:24,487 DEBUG [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-18 10:12:24,765 INFO [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307186d678a099bb84694b0fb8390d2d9fa10 to hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202307186d678a099bb84694b0fb8390d2d9fa10 2023-07-18 10:12:24,787 DEBUG [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 10:12:24,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-18 10:12:24,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-18 10:12:24,789 DEBUG [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-18 10:12:24,794 INFO [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemStateWithSkipTmp/13c2e8f0d4f3d80425ecfa834f0dfedc/.tmp/cf/e842bc65ddbb477bb6501ed391373774 2023-07-18 10:12:24,799 DEBUG [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemStateWithSkipTmp/13c2e8f0d4f3d80425ecfa834f0dfedc/.tmp/cf/e842bc65ddbb477bb6501ed391373774 as hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemStateWithSkipTmp/13c2e8f0d4f3d80425ecfa834f0dfedc/cf/e842bc65ddbb477bb6501ed391373774 2023-07-18 10:12:24,812 INFO [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemStateWithSkipTmp/13c2e8f0d4f3d80425ecfa834f0dfedc/cf/e842bc65ddbb477bb6501ed391373774, entries=44, sequenceid=6, filesize=12.8 K 2023-07-18 10:12:24,815 INFO [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.87 KB/2936, heapSize ~6.42 KB/6576, currentSize=0 B/0 for 13c2e8f0d4f3d80425ecfa834f0dfedc in 500ms, sequenceid=6, compaction requested=false 2023-07-18 10:12:24,815 DEBUG [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 13c2e8f0d4f3d80425ecfa834f0dfedc: 2023-07-18 10:12:24,815 DEBUG [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689675143070.13c2e8f0d4f3d80425ecfa834f0dfedc.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:24,815 DEBUG [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 10:12:24,815 DEBUG [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemStateWithSkipTmp/13c2e8f0d4f3d80425ecfa834f0dfedc/cf/e842bc65ddbb477bb6501ed391373774] hfiles 2023-07-18 10:12:24,815 DEBUG [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemStateWithSkipTmp/13c2e8f0d4f3d80425ecfa834f0dfedc/cf/e842bc65ddbb477bb6501ed391373774 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:24,855 DEBUG [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689675143070.13c2e8f0d4f3d80425ecfa834f0dfedc. completed. 2023-07-18 10:12:24,855 DEBUG [rs(jenkins-hbase4.apache.org,43301,1689675027670)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689675143070.13c2e8f0d4f3d80425ecfa834f0dfedc. 2023-07-18 10:12:24,855 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 10:12:24,856 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 10:12:24,856 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:12:24,856 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-18 10:12:24,856 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,43301,1689675027670' in zk 2023-07-18 10:12:24,858 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:12:24,858 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-18 10:12:24,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:12:24,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:12:24,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:12:24,858 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:12:24,858 DEBUG [member: 'jenkins-hbase4.apache.org,43301,1689675027670' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-18 10:12:24,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:12:24,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:12:24,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:24,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:12:24,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:12:24,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:12:24,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:12:24,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:24,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:12:24,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:12:24,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:12:24,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,43301,1689675027670': 2023-07-18 10:12:24,866 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43301,1689675027670' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-18 10:12:24,866 INFO [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-18 10:12:24,866 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-18 10:12:24,866 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-18 10:12:24,866 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:24,866 INFO [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-18 10:12:24,868 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:24,868 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:24,868 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:24,868 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:24,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:24,868 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:24,868 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:12:24,868 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:12:24,869 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:24,868 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:12:24,868 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:24,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:24,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:24,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 10:12:24,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 10:12:24,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:24,869 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:12:24,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:12:24,869 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:12:24,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:12:24,869 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:12:24,870 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:12:24,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:12:24,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:24,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:24,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 10:12:24,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:24,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:24,871 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:12:24,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 10:12:24,872 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:12:24,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:24,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:12:24,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:12:24,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:12:24,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 10:12:24,874 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:12:24,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:24,880 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:12:24,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:12:24,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:12:24,881 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:12:24,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:12:24,884 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:12:24,884 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:12:24,884 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:12:24,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:12:24,885 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:12:24,884 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:12:24,884 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 10:12:24,885 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:24,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:12:24,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 10:12:24,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:12:24,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:12:24,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 10:12:24,885 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:12:24,885 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:12:24,885 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 10:12:24,885 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:12:24,885 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:24,885 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:12:24,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:12:24,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:12:24,885 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:24,886 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:24,886 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:24,886 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-18 10:12:24,886 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 10:12:24,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:12:24,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 10:12:24,885 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:24,885 DEBUG [(jenkins-hbase4.apache.org,38235,1689675026088)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 10:12:24,886 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:12:24,886 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:12:24,888 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:24,888 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:24,889 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202307186d678a099bb84694b0fb8390d2d9fa10, hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230718108e0a0db84e4cbc85d71f60c62d79ff] mob files 2023-07-18 10:12:24,889 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202307186d678a099bb84694b0fb8390d2d9fa10 2023-07-18 10:12:24,889 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230718108e0a0db84e4cbc85d71f60c62d79ff 2023-07-18 10:12:24,906 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:24,907 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:24,963 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,289 DEBUG [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 10:12:25,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-18 10:12:25,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-18 10:12:25,290 DEBUG [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-07-18 10:12:25,463 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-18 10:12:25,464 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,464 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:25,464 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689675144180Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1689675144906 (+726 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689675144906Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1689675144906Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1689675144936 (+30 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689675144951 (+15 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689675145463 (+512 ms) 2023-07-18 10:12:25,467 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-18 10:12:25,469 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 1.2850 sec 2023-07-18 10:12:26,291 DEBUG [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 10:12:26,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-18 10:12:26,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-18 10:12:26,292 INFO [Listener at jenkins-hbase4.apache.org/34477] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/export-test/export-1689675146292 2023-07-18 10:12:26,292 INFO [Listener at jenkins-hbase4.apache.org/34477] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:44811, tgtDir=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/export-test/export-1689675146292, rawTgtDir=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/export-test/export-1689675146292, srcFsUri=hdfs://localhost:44811, srcDir=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427 2023-07-18 10:12:26,326 DEBUG [Listener at jenkins-hbase4.apache.org/34477] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44811, inputRoot=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427 2023-07-18 10:12:26,326 DEBUG [Listener at jenkins-hbase4.apache.org/34477] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1810800238_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/export-test/export-1689675146292, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/export-test/export-1689675146292/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:26,326 INFO [Listener at jenkins-hbase4.apache.org/34477] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44811, inputRoot=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427, snapshotDir=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-18 10:12:26,339 INFO [Listener at jenkins-hbase4.apache.org/34477] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/export-test/export-1689675146292/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:26,379 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-18 10:12:26,380 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-18 10:12:26,380 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-18 10:12:26,381 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-18 10:12:26,381 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-18 10:12:26,381 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-18 10:12:26,382 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-18 10:12:26,473 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c329d283-1f43-4a99-3860-7ed90b9830ca/hadoop-1190739124143611354.jar 2023-07-18 10:12:26,474 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-18 10:12:26,475 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-18 10:12:26,475 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-18 10:12:26,476 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-18 10:12:26,477 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-18 10:12:26,478 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-18 10:12:26,479 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-18 10:12:26,479 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-18 10:12:26,480 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-18 10:12:26,480 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-18 10:12:26,481 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-18 10:12:26,482 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-18 10:12:26,482 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-18 10:12:26,483 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-18 10:12:26,483 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-18 10:12:26,484 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-18 10:12:26,484 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 10:12:26,485 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 10:12:26,486 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 10:12:26,486 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 10:12:26,486 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 10:12:26,488 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 10:12:26,488 DEBUG [Listener at jenkins-hbase4.apache.org/34477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 10:12:26,898 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689675035640_0006_000001 (auth:SIMPLE) 2023-07-18 10:12:26,973 WARN [DataStreamer for file /user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/hadoop/mapreduce-am-staging-root-dir/jenkins/.staging/job_1689675035640_0007/libjars/hbase-metrics-api-2.4.18-SNAPSHOT.jar] hdfs.DataStreamer(982): Caught exception java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Thread.join(Thread.java:1257) at java.lang.Thread.join(Thread.java:1331) at org.apache.hadoop.hdfs.DataStreamer.closeResponder(DataStreamer.java:980) at org.apache.hadoop.hdfs.DataStreamer.endBlock(DataStreamer.java:630) at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:807) 2023-07-18 10:12:27,671 WARN [Listener at jenkins-hbase4.apache.org/34477] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-18 10:12:27,674 INFO [Listener at jenkins-hbase4.apache.org/34477] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-18 10:12:27,677 DEBUG [Listener at jenkins-hbase4.apache.org/34477] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-07-18 10:12:28,019 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 10:12:28,019 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 10:12:28,493 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-18 10:12:28,704 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689675035640_0007_000001 (auth:SIMPLE) 2023-07-18 10:12:35,015 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689675035640_0007_000001 (auth:SIMPLE) 2023-07-18 10:12:37,287 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689675035640_0007_000001 (auth:SIMPLE) 2023-07-18 10:12:41,503 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689675035640_0007_000001 (auth:SIMPLE) 2023-07-18 10:12:43,308 INFO [Listener at jenkins-hbase4.apache.org/34477] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-18 10:12:43,308 INFO [Listener at jenkins-hbase4.apache.org/34477] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-18 10:12:43,337 INFO [Listener at jenkins-hbase4.apache.org/34477] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:43,337 INFO [Listener at jenkins-hbase4.apache.org/34477] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-18 10:12:43,338 INFO [Listener at jenkins-hbase4.apache.org/34477] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-18 10:12:43,338 DEBUG [Listener at jenkins-hbase4.apache.org/34477] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_307542026_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:43,339 DEBUG [Listener at jenkins-hbase4.apache.org/34477] snapshot.TestExportSnapshot(367): hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-18 10:12:43,339 DEBUG [Listener at jenkins-hbase4.apache.org/34477] snapshot.TestExportSnapshot(367): hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-18 10:12:43,339 DEBUG [Listener at jenkins-hbase4.apache.org/34477] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_307542026_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/export-test/export-1689675146292/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/export-test/export-1689675146292/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:43,339 DEBUG [Listener at jenkins-hbase4.apache.org/34477] snapshot.TestExportSnapshot(367): hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/export-test/export-1689675146292/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-18 10:12:43,339 DEBUG [Listener at jenkins-hbase4.apache.org/34477] snapshot.TestExportSnapshot(367): hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/export-test/export-1689675146292/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-18 10:12:43,346 INFO [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:43,346 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:43,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:43,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-18 10:12:43,351 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689675163351"}]},"ts":"1689675163351"} 2023-07-18 10:12:43,352 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-18 10:12:43,354 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-18 10:12:43,355 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=00412595edf6ace19ac04ba736f60bc3, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=13c2e8f0d4f3d80425ecfa834f0dfedc, UNASSIGN}] 2023-07-18 10:12:43,357 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=13c2e8f0d4f3d80425ecfa834f0dfedc, UNASSIGN 2023-07-18 10:12:43,357 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=00412595edf6ace19ac04ba736f60bc3, UNASSIGN 2023-07-18 10:12:43,358 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=13c2e8f0d4f3d80425ecfa834f0dfedc, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:12:43,358 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=00412595edf6ace19ac04ba736f60bc3, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:12:43,358 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689675143070.13c2e8f0d4f3d80425ecfa834f0dfedc.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689675163358"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689675163358"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689675163358"}]},"ts":"1689675163358"} 2023-07-18 10:12:43,358 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689675143070.00412595edf6ace19ac04ba736f60bc3.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689675163358"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689675163358"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689675163358"}]},"ts":"1689675163358"} 2023-07-18 10:12:43,360 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE; CloseRegionProcedure 13c2e8f0d4f3d80425ecfa834f0dfedc, server=jenkins-hbase4.apache.org,43301,1689675027670}] 2023-07-18 10:12:43,361 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=115, state=RUNNABLE; CloseRegionProcedure 00412595edf6ace19ac04ba736f60bc3, server=jenkins-hbase4.apache.org,39709,1689675027617}] 2023-07-18 10:12:43,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-18 10:12:43,464 ERROR [ProcedureDispatcherTimeoutThread] procedure2.RemoteProcedureDispatcher$TimeoutExecutorThread(324): DelayQueue for RemoteProcedureDispatcher is not empty when timed waiting elapsed. If this is repeated consistently, it means no element is getting expired from the queue and it might freeze the system. Queue: [containedObject=jenkins-hbase4.apache.org,43301,1689675027670, timeout=1689675163512, delay=48, operations=[pid=117, ppid=116, state=RUNNABLE; CloseRegionProcedure 13c2e8f0d4f3d80425ecfa834f0dfedc, server=jenkins-hbase4.apache.org,43301,1689675027670], containedObject=jenkins-hbase4.apache.org,39709,1689675027617, timeout=1689675163513, delay=49, operations=[pid=118, ppid=115, state=RUNNABLE; CloseRegionProcedure 00412595edf6ace19ac04ba736f60bc3, server=jenkins-hbase4.apache.org,39709,1689675027617]] 2023-07-18 10:12:43,513 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 13c2e8f0d4f3d80425ecfa834f0dfedc 2023-07-18 10:12:43,513 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 13c2e8f0d4f3d80425ecfa834f0dfedc, disabling compactions & flushes 2023-07-18 10:12:43,513 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689675143070.13c2e8f0d4f3d80425ecfa834f0dfedc. 2023-07-18 10:12:43,513 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689675143070.13c2e8f0d4f3d80425ecfa834f0dfedc. 2023-07-18 10:12:43,513 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689675143070.13c2e8f0d4f3d80425ecfa834f0dfedc. after waiting 0 ms 2023-07-18 10:12:43,513 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689675143070.13c2e8f0d4f3d80425ecfa834f0dfedc. 2023-07-18 10:12:43,515 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 00412595edf6ace19ac04ba736f60bc3 2023-07-18 10:12:43,517 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 00412595edf6ace19ac04ba736f60bc3, disabling compactions & flushes 2023-07-18 10:12:43,517 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689675143070.00412595edf6ace19ac04ba736f60bc3. 2023-07-18 10:12:43,517 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689675143070.00412595edf6ace19ac04ba736f60bc3. 2023-07-18 10:12:43,517 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689675143070.00412595edf6ace19ac04ba736f60bc3. after waiting 0 ms 2023-07-18 10:12:43,517 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689675143070.00412595edf6ace19ac04ba736f60bc3. 2023-07-18 10:12:43,529 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemStateWithSkipTmp/13c2e8f0d4f3d80425ecfa834f0dfedc/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-18 10:12:43,530 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/default/testtb-testExportFileSystemStateWithSkipTmp/00412595edf6ace19ac04ba736f60bc3/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-18 10:12:43,530 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 10:12:43,530 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 10:12:43,531 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689675143070.00412595edf6ace19ac04ba736f60bc3. 2023-07-18 10:12:43,532 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689675143070.13c2e8f0d4f3d80425ecfa834f0dfedc. 2023-07-18 10:12:43,532 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 00412595edf6ace19ac04ba736f60bc3: 2023-07-18 10:12:43,532 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 13c2e8f0d4f3d80425ecfa834f0dfedc: 2023-07-18 10:12:43,534 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 13c2e8f0d4f3d80425ecfa834f0dfedc 2023-07-18 10:12:43,534 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=13c2e8f0d4f3d80425ecfa834f0dfedc, regionState=CLOSED 2023-07-18 10:12:43,534 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689675143070.13c2e8f0d4f3d80425ecfa834f0dfedc.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689675163534"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689675163534"}]},"ts":"1689675163534"} 2023-07-18 10:12:43,534 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 00412595edf6ace19ac04ba736f60bc3 2023-07-18 10:12:43,535 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=00412595edf6ace19ac04ba736f60bc3, regionState=CLOSED 2023-07-18 10:12:43,535 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689675143070.00412595edf6ace19ac04ba736f60bc3.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689675163535"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689675163535"}]},"ts":"1689675163535"} 2023-07-18 10:12:43,538 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=116 2023-07-18 10:12:43,538 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=116, state=SUCCESS; CloseRegionProcedure 13c2e8f0d4f3d80425ecfa834f0dfedc, server=jenkins-hbase4.apache.org,43301,1689675027670 in 177 msec 2023-07-18 10:12:43,539 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=115 2023-07-18 10:12:43,539 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=115, state=SUCCESS; CloseRegionProcedure 00412595edf6ace19ac04ba736f60bc3, server=jenkins-hbase4.apache.org,39709,1689675027617 in 176 msec 2023-07-18 10:12:43,540 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=13c2e8f0d4f3d80425ecfa834f0dfedc, UNASSIGN in 183 msec 2023-07-18 10:12:43,541 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=115, resume processing ppid=114 2023-07-18 10:12:43,541 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=00412595edf6ace19ac04ba736f60bc3, UNASSIGN in 184 msec 2023-07-18 10:12:43,541 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689675163541"}]},"ts":"1689675163541"} 2023-07-18 10:12:43,543 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-18 10:12:43,544 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-18 10:12:43,546 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 199 msec 2023-07-18 10:12:43,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-18 10:12:43,654 INFO [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-18 10:12:43,655 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:43,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:43,659 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:43,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:43,660 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:43,663 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43301] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:43,667 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/00412595edf6ace19ac04ba736f60bc3 2023-07-18 10:12:43,667 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/13c2e8f0d4f3d80425ecfa834f0dfedc 2023-07-18 10:12:43,668 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:43,668 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:43,668 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:43,668 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:43,669 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-18 10:12:43,669 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-18 10:12:43,669 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-18 10:12:43,670 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-18 10:12:43,671 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:43,671 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:12:43,671 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:43,671 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:12:43,671 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:43,671 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:12:43,671 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:43,671 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 10:12:43,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-18 10:12:43,679 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/00412595edf6ace19ac04ba736f60bc3/cf, FileablePath, hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/00412595edf6ace19ac04ba736f60bc3/recovered.edits] 2023-07-18 10:12:43,679 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/13c2e8f0d4f3d80425ecfa834f0dfedc/cf, FileablePath, hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/13c2e8f0d4f3d80425ecfa834f0dfedc/recovered.edits] 2023-07-18 10:12:43,689 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/00412595edf6ace19ac04ba736f60bc3/cf/69e3554d98224cdf8c1561ff7dd6404b to hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/00412595edf6ace19ac04ba736f60bc3/cf/69e3554d98224cdf8c1561ff7dd6404b 2023-07-18 10:12:43,689 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/13c2e8f0d4f3d80425ecfa834f0dfedc/cf/e842bc65ddbb477bb6501ed391373774 to hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/13c2e8f0d4f3d80425ecfa834f0dfedc/cf/e842bc65ddbb477bb6501ed391373774 2023-07-18 10:12:43,694 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/00412595edf6ace19ac04ba736f60bc3/recovered.edits/9.seqid to hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/00412595edf6ace19ac04ba736f60bc3/recovered.edits/9.seqid 2023-07-18 10:12:43,695 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/00412595edf6ace19ac04ba736f60bc3 2023-07-18 10:12:43,695 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/13c2e8f0d4f3d80425ecfa834f0dfedc/recovered.edits/9.seqid to hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/13c2e8f0d4f3d80425ecfa834f0dfedc/recovered.edits/9.seqid 2023-07-18 10:12:43,696 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/13c2e8f0d4f3d80425ecfa834f0dfedc 2023-07-18 10:12:43,696 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-18 10:12:43,696 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-18 10:12:43,697 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-07-18 10:12:43,708 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202307186d678a099bb84694b0fb8390d2d9fa10 to hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202307186d678a099bb84694b0fb8390d2d9fa10 2023-07-18 10:12:43,710 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230718108e0a0db84e4cbc85d71f60c62d79ff to hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230718108e0a0db84e4cbc85d71f60c62d79ff 2023-07-18 10:12:43,710 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-18 10:12:43,713 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:43,717 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-18 10:12:43,719 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-18 10:12:43,720 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:43,720 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-18 10:12:43,720 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689675143070.00412595edf6ace19ac04ba736f60bc3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689675163720"}]},"ts":"9223372036854775807"} 2023-07-18 10:12:43,721 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689675143070.13c2e8f0d4f3d80425ecfa834f0dfedc.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689675163720"}]},"ts":"9223372036854775807"} 2023-07-18 10:12:43,723 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-18 10:12:43,723 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 00412595edf6ace19ac04ba736f60bc3, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689675143070.00412595edf6ace19ac04ba736f60bc3.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 13c2e8f0d4f3d80425ecfa834f0dfedc, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689675143070.13c2e8f0d4f3d80425ecfa834f0dfedc.', STARTKEY => '1', ENDKEY => ''}] 2023-07-18 10:12:43,723 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-18 10:12:43,723 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689675163723"}]},"ts":"9223372036854775807"} 2023-07-18 10:12:43,729 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-18 10:12:43,732 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:43,734 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 77 msec 2023-07-18 10:12:43,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-18 10:12:43,775 INFO [Listener at jenkins-hbase4.apache.org/34477] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-18 10:12:43,783 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-18 10:12:43,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:43,787 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-18 10:12:43,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38235] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 10:12:43,823 INFO [Listener at jenkins-hbase4.apache.org/34477] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=761 (was 758) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x36ae74de-shared-pool-42 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x36ae74de-shared-pool-40 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_307542026_17 at /127.0.0.1:50652 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5428 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_307542026_17 at /127.0.0.1:35078 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1575947067_1 at /127.0.0.1:35052 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1575947067_1 at /127.0.0.1:47804 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x36ae74de-shared-pool-43 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x36ae74de-shared-pool-41 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_307542026_17 at /127.0.0.1:47830 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1988502388) connection to jenkins-hbase4.apache.org/172.31.14.131:45423 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=901 (was 905), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=649 (was 590) - SystemLoadAverage LEAK? -, ProcessCount=184 (was 184), AvailableMemoryMB=1494 (was 1687) 2023-07-18 10:12:43,823 WARN [Listener at jenkins-hbase4.apache.org/34477] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-07-18 10:12:43,823 INFO [Listener at jenkins-hbase4.apache.org/34477] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-18 10:12:43,834 INFO [Listener at jenkins-hbase4.apache.org/34477] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-18 10:12:47,731 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689675035640_0007_000001 (auth:SIMPLE) 2023-07-18 10:12:49,102 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-18 10:12:57,968 INFO [Listener at jenkins-hbase4.apache.org/34477] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-18 10:13:12,085 ERROR [Thread[Thread-410,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-18 10:13:12,086 INFO [Listener at jenkins-hbase4.apache.org/34477] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-18 10:13:12,195 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-18 10:13:12,206 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-18 10:13:12,207 ERROR [Thread[Thread-420,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-18 10:13:12,219 INFO [Listener at jenkins-hbase4.apache.org/34477] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-18 10:13:12,323 ERROR [Thread[Thread-385,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-18 10:13:12,323 INFO [Listener at jenkins-hbase4.apache.org/34477] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-18 10:13:12,323 INFO [Listener at jenkins-hbase4.apache.org/34477] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-18 10:13:12,323 INFO [Listener at jenkins-hbase4.apache.org/34477] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-18 10:13:12,323 DEBUG [Listener at jenkins-hbase4.apache.org/34477] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0789e732 to 127.0.0.1:60990 2023-07-18 10:13:12,323 DEBUG [Listener at jenkins-hbase4.apache.org/34477] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 10:13:12,323 DEBUG [Listener at jenkins-hbase4.apache.org/34477] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-18 10:13:12,324 DEBUG [Listener at jenkins-hbase4.apache.org/34477] util.JVMClusterUtil(257): Found active master hash=1677951855, stopped=false 2023-07-18 10:13:12,324 DEBUG [Listener at jenkins-hbase4.apache.org/34477] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 10:13:12,324 DEBUG [Listener at jenkins-hbase4.apache.org/34477] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-18 10:13:12,324 INFO [Listener at jenkins-hbase4.apache.org/34477] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,38235,1689675026088 2023-07-18 10:13:12,325 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-18 10:13:12,325 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-18 10:13:12,325 INFO [Listener at jenkins-hbase4.apache.org/34477] procedure2.ProcedureExecutor(629): Stopping 2023-07-18 10:13:12,325 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-18 10:13:12,325 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-18 10:13:12,326 DEBUG [Listener at jenkins-hbase4.apache.org/34477] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2cdbbc26 to 127.0.0.1:60990 2023-07-18 10:13:12,325 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 10:13:12,326 DEBUG [Listener at jenkins-hbase4.apache.org/34477] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 10:13:12,326 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-18 10:13:12,326 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-18 10:13:12,326 INFO [Listener at jenkins-hbase4.apache.org/34477] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,37417,1689675027545' ***** 2023-07-18 10:13:12,326 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-18 10:13:12,326 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-18 10:13:12,326 DEBUG [Listener at jenkins-hbase4.apache.org/34477] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 10:13:12,326 INFO [Listener at jenkins-hbase4.apache.org/34477] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-18 10:13:12,327 INFO [Listener at jenkins-hbase4.apache.org/34477] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,39709,1689675027617' ***** 2023-07-18 10:13:12,327 INFO [RS:0;jenkins-hbase4:37417] regionserver.HeapMemoryManager(220): Stopping 2023-07-18 10:13:12,327 DEBUG [Listener at jenkins-hbase4.apache.org/34477] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 10:13:12,327 INFO [Listener at jenkins-hbase4.apache.org/34477] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-18 10:13:12,327 INFO [RS:0;jenkins-hbase4:37417] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-18 10:13:12,327 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-18 10:13:12,327 INFO [RS:1;jenkins-hbase4:39709] regionserver.HeapMemoryManager(220): Stopping 2023-07-18 10:13:12,327 INFO [RS:0;jenkins-hbase4:37417] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-18 10:13:12,327 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-18 10:13:12,327 INFO [Listener at jenkins-hbase4.apache.org/34477] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,43301,1689675027670' ***** 2023-07-18 10:13:12,327 INFO [RS:0;jenkins-hbase4:37417] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:13:12,327 DEBUG [Listener at jenkins-hbase4.apache.org/34477] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 10:13:12,327 INFO [RS:1;jenkins-hbase4:39709] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-18 10:13:12,327 INFO [Listener at jenkins-hbase4.apache.org/34477] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-18 10:13:12,328 INFO [RS:1;jenkins-hbase4:39709] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-18 10:13:12,327 DEBUG [RS:0;jenkins-hbase4:37417] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x31dff6bb to 127.0.0.1:60990 2023-07-18 10:13:12,328 DEBUG [RS:0;jenkins-hbase4:37417] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 10:13:12,328 INFO [RS:2;jenkins-hbase4:43301] regionserver.HeapMemoryManager(220): Stopping 2023-07-18 10:13:12,328 INFO [RS:1;jenkins-hbase4:39709] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:13:12,330 INFO [RS:2;jenkins-hbase4:43301] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-18 10:13:12,330 DEBUG [RS:1;jenkins-hbase4:39709] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x686d5526 to 127.0.0.1:60990 2023-07-18 10:13:12,330 INFO [RS:2;jenkins-hbase4:43301] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-18 10:13:12,330 DEBUG [RS:1;jenkins-hbase4:39709] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 10:13:12,330 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-18 10:13:12,330 INFO [RS:0;jenkins-hbase4:37417] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,37417,1689675027545; all regions closed. 2023-07-18 10:13:12,331 INFO [RS:2;jenkins-hbase4:43301] regionserver.HRegionServer(3305): Received CLOSE for 0e5e0781d45bc8cd4efbc8924275e1db 2023-07-18 10:13:12,331 INFO [RS:1;jenkins-hbase4:39709] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-18 10:13:12,331 INFO [RS:1;jenkins-hbase4:39709] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-18 10:13:12,331 INFO [RS:1;jenkins-hbase4:39709] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-18 10:13:12,331 INFO [RS:1;jenkins-hbase4:39709] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-18 10:13:12,331 INFO [RS:2;jenkins-hbase4:43301] regionserver.HRegionServer(3305): Received CLOSE for 7121957271154b496922f73cd6af8f4b 2023-07-18 10:13:12,332 INFO [RS:2;jenkins-hbase4:43301] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:13:12,332 INFO [RS:1;jenkins-hbase4:39709] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-18 10:13:12,332 DEBUG [RS:2;jenkins-hbase4:43301] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x250ee95f to 127.0.0.1:60990 2023-07-18 10:13:12,332 DEBUG [RS:1;jenkins-hbase4:39709] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-07-18 10:13:12,332 DEBUG [RS:2;jenkins-hbase4:43301] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 10:13:12,332 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0e5e0781d45bc8cd4efbc8924275e1db, disabling compactions & flushes 2023-07-18 10:13:12,332 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689675030420.0e5e0781d45bc8cd4efbc8924275e1db. 2023-07-18 10:13:12,333 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-18 10:13:12,333 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689675030420.0e5e0781d45bc8cd4efbc8924275e1db. 2023-07-18 10:13:12,333 INFO [RS:2;jenkins-hbase4:43301] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-07-18 10:13:12,333 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689675030420.0e5e0781d45bc8cd4efbc8924275e1db. after waiting 0 ms 2023-07-18 10:13:12,333 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-18 10:13:12,333 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689675030420.0e5e0781d45bc8cd4efbc8924275e1db. 2023-07-18 10:13:12,333 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-18 10:13:12,333 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 0e5e0781d45bc8cd4efbc8924275e1db 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-18 10:13:12,333 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-18 10:13:12,333 DEBUG [RS:2;jenkins-hbase4:43301] regionserver.HRegionServer(1478): Online Regions={0e5e0781d45bc8cd4efbc8924275e1db=hbase:namespace,,1689675030420.0e5e0781d45bc8cd4efbc8924275e1db., 7121957271154b496922f73cd6af8f4b=hbase:acl,,1689675031330.7121957271154b496922f73cd6af8f4b.} 2023-07-18 10:13:12,333 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-18 10:13:12,333 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-18 10:13:12,333 DEBUG [RS:1;jenkins-hbase4:39709] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-18 10:13:12,333 DEBUG [RS:2;jenkins-hbase4:43301] regionserver.HRegionServer(1504): Waiting on 0e5e0781d45bc8cd4efbc8924275e1db, 7121957271154b496922f73cd6af8f4b 2023-07-18 10:13:12,355 DEBUG [RS:0;jenkins-hbase4:37417] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/oldWALs 2023-07-18 10:13:12,355 INFO [RS:0;jenkins-hbase4:37417] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C37417%2C1689675027545:(num 1689675029887) 2023-07-18 10:13:12,355 DEBUG [RS:0;jenkins-hbase4:37417] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 10:13:12,355 INFO [RS:0;jenkins-hbase4:37417] regionserver.LeaseManager(133): Closed leases 2023-07-18 10:13:12,356 INFO [RS:0;jenkins-hbase4:37417] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-18 10:13:12,356 INFO [RS:0;jenkins-hbase4:37417] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-18 10:13:12,356 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-18 10:13:12,356 INFO [RS:0;jenkins-hbase4:37417] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-18 10:13:12,356 INFO [RS:0;jenkins-hbase4:37417] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-18 10:13:12,357 INFO [RS:0;jenkins-hbase4:37417] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37417 2023-07-18 10:13:12,358 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/hbase/namespace/0e5e0781d45bc8cd4efbc8924275e1db/.tmp/info/6f005b3413eb4e9fa2ef18e4fd094df6 2023-07-18 10:13:12,359 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/hbase/meta/1588230740/.tmp/info/1d6f2c522df34b199c92eebbdc0d5fdf 2023-07-18 10:13:12,364 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:13:12,364 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-18 10:13:12,364 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-18 10:13:12,364 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-18 10:13:12,364 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:13:12,364 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-18 10:13:12,364 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37417,1689675027545 2023-07-18 10:13:12,365 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-18 10:13:12,365 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-18 10:13:12,366 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1d6f2c522df34b199c92eebbdc0d5fdf 2023-07-18 10:13:12,367 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,37417,1689675027545] 2023-07-18 10:13:12,367 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,37417,1689675027545; numProcessing=1 2023-07-18 10:13:12,367 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/hbase/namespace/0e5e0781d45bc8cd4efbc8924275e1db/.tmp/info/6f005b3413eb4e9fa2ef18e4fd094df6 as hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/hbase/namespace/0e5e0781d45bc8cd4efbc8924275e1db/info/6f005b3413eb4e9fa2ef18e4fd094df6 2023-07-18 10:13:12,370 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,37417,1689675027545 already deleted, retry=false 2023-07-18 10:13:12,370 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,37417,1689675027545 expired; onlineServers=2 2023-07-18 10:13:12,372 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/hbase/namespace/0e5e0781d45bc8cd4efbc8924275e1db/info/6f005b3413eb4e9fa2ef18e4fd094df6, entries=2, sequenceid=6, filesize=4.8 K 2023-07-18 10:13:12,373 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 0e5e0781d45bc8cd4efbc8924275e1db in 40ms, sequenceid=6, compaction requested=false 2023-07-18 10:13:12,377 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/hbase/meta/1588230740/.tmp/rep_barrier/a0675be7491a4d06a346f4e3bcfd2296 2023-07-18 10:13:12,378 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/hbase/namespace/0e5e0781d45bc8cd4efbc8924275e1db/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-18 10:13:12,378 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 10:13:12,379 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689675030420.0e5e0781d45bc8cd4efbc8924275e1db. 2023-07-18 10:13:12,379 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0e5e0781d45bc8cd4efbc8924275e1db: 2023-07-18 10:13:12,379 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689675030420.0e5e0781d45bc8cd4efbc8924275e1db. 2023-07-18 10:13:12,379 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7121957271154b496922f73cd6af8f4b, disabling compactions & flushes 2023-07-18 10:13:12,379 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689675031330.7121957271154b496922f73cd6af8f4b. 2023-07-18 10:13:12,380 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689675031330.7121957271154b496922f73cd6af8f4b. 2023-07-18 10:13:12,380 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689675031330.7121957271154b496922f73cd6af8f4b. after waiting 0 ms 2023-07-18 10:13:12,380 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689675031330.7121957271154b496922f73cd6af8f4b. 2023-07-18 10:13:12,380 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 7121957271154b496922f73cd6af8f4b 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-18 10:13:12,386 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a0675be7491a4d06a346f4e3bcfd2296 2023-07-18 10:13:12,395 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/hbase/acl/7121957271154b496922f73cd6af8f4b/.tmp/l/2e6f2e932d814e1a801280e6a86d1638 2023-07-18 10:13:12,398 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/hbase/meta/1588230740/.tmp/table/da13ab79f804473e97c89529f2a394bd 2023-07-18 10:13:12,402 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for da13ab79f804473e97c89529f2a394bd 2023-07-18 10:13:12,402 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2e6f2e932d814e1a801280e6a86d1638 2023-07-18 10:13:12,403 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/hbase/acl/7121957271154b496922f73cd6af8f4b/.tmp/l/2e6f2e932d814e1a801280e6a86d1638 as hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/hbase/acl/7121957271154b496922f73cd6af8f4b/l/2e6f2e932d814e1a801280e6a86d1638 2023-07-18 10:13:12,404 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/hbase/meta/1588230740/.tmp/info/1d6f2c522df34b199c92eebbdc0d5fdf as hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/hbase/meta/1588230740/info/1d6f2c522df34b199c92eebbdc0d5fdf 2023-07-18 10:13:12,408 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-18 10:13:12,409 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2e6f2e932d814e1a801280e6a86d1638 2023-07-18 10:13:12,409 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/hbase/acl/7121957271154b496922f73cd6af8f4b/l/2e6f2e932d814e1a801280e6a86d1638, entries=7, sequenceid=18, filesize=5.2 K 2023-07-18 10:13:12,410 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 7121957271154b496922f73cd6af8f4b in 30ms, sequenceid=18, compaction requested=false 2023-07-18 10:13:12,412 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1d6f2c522df34b199c92eebbdc0d5fdf 2023-07-18 10:13:12,412 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/hbase/meta/1588230740/info/1d6f2c522df34b199c92eebbdc0d5fdf, entries=48, sequenceid=131, filesize=10.3 K 2023-07-18 10:13:12,413 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/hbase/meta/1588230740/.tmp/rep_barrier/a0675be7491a4d06a346f4e3bcfd2296 as hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/hbase/meta/1588230740/rep_barrier/a0675be7491a4d06a346f4e3bcfd2296 2023-07-18 10:13:12,419 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/hbase/acl/7121957271154b496922f73cd6af8f4b/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-18 10:13:12,419 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a0675be7491a4d06a346f4e3bcfd2296 2023-07-18 10:13:12,419 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/hbase/meta/1588230740/rep_barrier/a0675be7491a4d06a346f4e3bcfd2296, entries=13, sequenceid=131, filesize=6.4 K 2023-07-18 10:13:12,420 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 10:13:12,420 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1689675031330.7121957271154b496922f73cd6af8f4b. 2023-07-18 10:13:12,420 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7121957271154b496922f73cd6af8f4b: 2023-07-18 10:13:12,420 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1689675031330.7121957271154b496922f73cd6af8f4b. 2023-07-18 10:13:12,421 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/hbase/meta/1588230740/.tmp/table/da13ab79f804473e97c89529f2a394bd as hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/hbase/meta/1588230740/table/da13ab79f804473e97c89529f2a394bd 2023-07-18 10:13:12,426 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for da13ab79f804473e97c89529f2a394bd 2023-07-18 10:13:12,426 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/hbase/meta/1588230740/table/da13ab79f804473e97c89529f2a394bd, entries=24, sequenceid=131, filesize=6.9 K 2023-07-18 10:13:12,427 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 94ms, sequenceid=131, compaction requested=false 2023-07-18 10:13:12,447 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-18 10:13:12,448 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 10:13:12,448 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-18 10:13:12,448 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-18 10:13:12,449 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-18 10:13:12,449 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-18 10:13:12,466 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-18 10:13:12,467 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:37417-0x10177e94dd40001, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-18 10:13:12,467 INFO [RS:0;jenkins-hbase4:37417] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,37417,1689675027545; zookeeper connection closed. 2023-07-18 10:13:12,467 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@6290c22d] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@6290c22d 2023-07-18 10:13:12,534 INFO [RS:1;jenkins-hbase4:39709] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,39709,1689675027617; all regions closed. 2023-07-18 10:13:12,534 INFO [RS:2;jenkins-hbase4:43301] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,43301,1689675027670; all regions closed. 2023-07-18 10:13:12,541 DEBUG [RS:1;jenkins-hbase4:39709] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/oldWALs 2023-07-18 10:13:12,541 INFO [RS:1;jenkins-hbase4:39709] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39709%2C1689675027617.meta:.meta(num 1689675030063) 2023-07-18 10:13:12,542 DEBUG [RS:2;jenkins-hbase4:43301] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/oldWALs 2023-07-18 10:13:12,542 INFO [RS:2;jenkins-hbase4:43301] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43301%2C1689675027670:(num 1689675029895) 2023-07-18 10:13:12,542 DEBUG [RS:2;jenkins-hbase4:43301] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 10:13:12,542 INFO [RS:2;jenkins-hbase4:43301] regionserver.LeaseManager(133): Closed leases 2023-07-18 10:13:12,543 INFO [RS:2;jenkins-hbase4:43301] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-18 10:13:12,544 INFO [RS:2;jenkins-hbase4:43301] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-18 10:13:12,544 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-18 10:13:12,544 INFO [RS:2;jenkins-hbase4:43301] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-18 10:13:12,545 INFO [RS:2;jenkins-hbase4:43301] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-18 10:13:12,546 INFO [RS:2;jenkins-hbase4:43301] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43301 2023-07-18 10:13:12,549 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:13:12,549 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-18 10:13:12,549 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43301,1689675027670 2023-07-18 10:13:12,551 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,43301,1689675027670] 2023-07-18 10:13:12,551 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,43301,1689675027670; numProcessing=2 2023-07-18 10:13:12,558 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,43301,1689675027670 already deleted, retry=false 2023-07-18 10:13:12,558 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,43301,1689675027670 expired; onlineServers=1 2023-07-18 10:13:12,558 DEBUG [RS:1;jenkins-hbase4:39709] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/oldWALs 2023-07-18 10:13:12,559 INFO [RS:1;jenkins-hbase4:39709] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39709%2C1689675027617:(num 1689675029879) 2023-07-18 10:13:12,559 DEBUG [RS:1;jenkins-hbase4:39709] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 10:13:12,559 INFO [RS:1;jenkins-hbase4:39709] regionserver.LeaseManager(133): Closed leases 2023-07-18 10:13:12,559 INFO [RS:1;jenkins-hbase4:39709] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-18 10:13:12,559 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-18 10:13:12,560 INFO [RS:1;jenkins-hbase4:39709] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39709 2023-07-18 10:13:12,561 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-18 10:13:12,561 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39709,1689675027617 2023-07-18 10:13:12,562 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,39709,1689675027617] 2023-07-18 10:13:12,562 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,39709,1689675027617; numProcessing=3 2023-07-18 10:13:12,564 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,39709,1689675027617 already deleted, retry=false 2023-07-18 10:13:12,564 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,39709,1689675027617 expired; onlineServers=0 2023-07-18 10:13:12,564 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,38235,1689675026088' ***** 2023-07-18 10:13:12,564 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-18 10:13:12,565 DEBUG [M:0;jenkins-hbase4:38235] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@253e8954, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-18 10:13:12,565 INFO [M:0;jenkins-hbase4:38235] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,38235,1689675026088 2023-07-18 10:13:12,565 INFO [M:0;jenkins-hbase4:38235] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,38235,1689675026088; all regions closed. 2023-07-18 10:13:12,565 DEBUG [M:0;jenkins-hbase4:38235] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 10:13:12,565 DEBUG [M:0;jenkins-hbase4:38235] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-18 10:13:12,565 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-18 10:13:12,565 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689675029372] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689675029372,5,FailOnTimeoutGroup] 2023-07-18 10:13:12,565 DEBUG [M:0;jenkins-hbase4:38235] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-18 10:13:12,565 INFO [M:0;jenkins-hbase4:38235] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-18 10:13:12,565 INFO [M:0;jenkins-hbase4:38235] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-18 10:13:12,565 INFO [M:0;jenkins-hbase4:38235] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-07-18 10:13:12,565 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689675029367] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689675029367,5,FailOnTimeoutGroup] 2023-07-18 10:13:12,566 DEBUG [M:0;jenkins-hbase4:38235] master.HMaster(1512): Stopping service threads 2023-07-18 10:13:12,566 INFO [M:0;jenkins-hbase4:38235] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-18 10:13:12,566 ERROR [M:0;jenkins-hbase4:38235] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-18 10:13:12,567 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-18 10:13:12,567 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 10:13:12,567 INFO [M:0;jenkins-hbase4:38235] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-18 10:13:12,567 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-18 10:13:12,568 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-18 10:13:12,568 DEBUG [M:0;jenkins-hbase4:38235] zookeeper.ZKUtil(398): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-18 10:13:12,568 WARN [M:0;jenkins-hbase4:38235] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-18 10:13:12,568 INFO [M:0;jenkins-hbase4:38235] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-18 10:13:12,569 INFO [M:0;jenkins-hbase4:38235] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-18 10:13:12,569 DEBUG [M:0;jenkins-hbase4:38235] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-18 10:13:12,569 INFO [M:0;jenkins-hbase4:38235] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-18 10:13:12,569 DEBUG [M:0;jenkins-hbase4:38235] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-18 10:13:12,569 DEBUG [M:0;jenkins-hbase4:38235] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-18 10:13:12,569 DEBUG [M:0;jenkins-hbase4:38235] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-18 10:13:12,569 INFO [M:0;jenkins-hbase4:38235] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.68 KB heapSize=451.98 KB 2023-07-18 10:13:12,590 INFO [M:0;jenkins-hbase4:38235] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.68 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/b4ca633b42e84792ba91014fdbffc2b0 2023-07-18 10:13:12,594 INFO [M:0;jenkins-hbase4:38235] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b4ca633b42e84792ba91014fdbffc2b0 2023-07-18 10:13:12,595 DEBUG [M:0;jenkins-hbase4:38235] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/b4ca633b42e84792ba91014fdbffc2b0 as hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/b4ca633b42e84792ba91014fdbffc2b0 2023-07-18 10:13:12,600 INFO [M:0;jenkins-hbase4:38235] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b4ca633b42e84792ba91014fdbffc2b0 2023-07-18 10:13:12,600 INFO [M:0;jenkins-hbase4:38235] regionserver.HStore(1080): Added hdfs://localhost:44811/user/jenkins/test-data/d6dfc1cf-ab82-685c-1036-d6b5c8cfa427/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/b4ca633b42e84792ba91014fdbffc2b0, entries=119, sequenceid=899, filesize=28.6 K 2023-07-18 10:13:12,602 INFO [M:0;jenkins-hbase4:38235] regionserver.HRegion(2948): Finished flush of dataSize ~375.68 KB/384699, heapSize ~451.96 KB/462808, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 33ms, sequenceid=899, compaction requested=false 2023-07-18 10:13:12,608 INFO [M:0;jenkins-hbase4:38235] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-18 10:13:12,608 DEBUG [M:0;jenkins-hbase4:38235] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-18 10:13:12,623 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-18 10:13:12,623 INFO [M:0;jenkins-hbase4:38235] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-18 10:13:12,624 INFO [M:0;jenkins-hbase4:38235] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38235 2023-07-18 10:13:12,625 DEBUG [M:0;jenkins-hbase4:38235] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,38235,1689675026088 already deleted, retry=false 2023-07-18 10:13:12,658 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-18 10:13:12,658 INFO [RS:2;jenkins-hbase4:43301] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,43301,1689675027670; zookeeper connection closed. 2023-07-18 10:13:12,659 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:43301-0x10177e94dd40003, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-18 10:13:12,659 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5ca9d113] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5ca9d113 2023-07-18 10:13:12,759 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-18 10:13:12,759 INFO [M:0;jenkins-hbase4:38235] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,38235,1689675026088; zookeeper connection closed. 2023-07-18 10:13:12,759 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): master:38235-0x10177e94dd40000, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-18 10:13:12,859 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-18 10:13:12,859 INFO [RS:1;jenkins-hbase4:39709] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,39709,1689675027617; zookeeper connection closed. 2023-07-18 10:13:12,859 DEBUG [Listener at localhost/33477-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x10177e94dd40002, quorum=127.0.0.1:60990, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-18 10:13:12,859 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@3ecdeacf] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@3ecdeacf 2023-07-18 10:13:12,859 INFO [Listener at jenkins-hbase4.apache.org/34477] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-18 10:13:12,860 WARN [Listener at jenkins-hbase4.apache.org/34477] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-18 10:13:12,892 INFO [Listener at jenkins-hbase4.apache.org/34477] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-18 10:13:12,997 WARN [BP-1058142615-172.31.14.131-1689675022078 heartbeating to localhost/127.0.0.1:44811] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-18 10:13:12,997 WARN [BP-1058142615-172.31.14.131-1689675022078 heartbeating to localhost/127.0.0.1:44811] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1058142615-172.31.14.131-1689675022078 (Datanode Uuid 4ea6fd35-36a3-4881-8109-11ae1d968b65) service to localhost/127.0.0.1:44811 2023-07-18 10:13:12,999 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c329d283-1f43-4a99-3860-7ed90b9830ca/cluster_838469a3-f099-4817-4d19-bba87533c742/dfs/data/data5/current/BP-1058142615-172.31.14.131-1689675022078] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-18 10:13:13,000 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c329d283-1f43-4a99-3860-7ed90b9830ca/cluster_838469a3-f099-4817-4d19-bba87533c742/dfs/data/data6/current/BP-1058142615-172.31.14.131-1689675022078] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-18 10:13:13,002 WARN [Listener at jenkins-hbase4.apache.org/34477] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-18 10:13:13,004 INFO [Listener at jenkins-hbase4.apache.org/34477] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-18 10:13:13,110 WARN [BP-1058142615-172.31.14.131-1689675022078 heartbeating to localhost/127.0.0.1:44811] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-18 10:13:13,110 WARN [BP-1058142615-172.31.14.131-1689675022078 heartbeating to localhost/127.0.0.1:44811] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1058142615-172.31.14.131-1689675022078 (Datanode Uuid 7469db32-c65d-4c3d-90c0-ff2000ea9037) service to localhost/127.0.0.1:44811 2023-07-18 10:13:13,111 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c329d283-1f43-4a99-3860-7ed90b9830ca/cluster_838469a3-f099-4817-4d19-bba87533c742/dfs/data/data3/current/BP-1058142615-172.31.14.131-1689675022078] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-18 10:13:13,111 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c329d283-1f43-4a99-3860-7ed90b9830ca/cluster_838469a3-f099-4817-4d19-bba87533c742/dfs/data/data4/current/BP-1058142615-172.31.14.131-1689675022078] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-18 10:13:13,112 WARN [Listener at jenkins-hbase4.apache.org/34477] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-18 10:13:13,115 INFO [Listener at jenkins-hbase4.apache.org/34477] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-18 10:13:13,219 WARN [BP-1058142615-172.31.14.131-1689675022078 heartbeating to localhost/127.0.0.1:44811] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-18 10:13:13,219 WARN [BP-1058142615-172.31.14.131-1689675022078 heartbeating to localhost/127.0.0.1:44811] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1058142615-172.31.14.131-1689675022078 (Datanode Uuid 18112d50-df5d-414d-a342-3305eb50303d) service to localhost/127.0.0.1:44811 2023-07-18 10:13:13,219 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c329d283-1f43-4a99-3860-7ed90b9830ca/cluster_838469a3-f099-4817-4d19-bba87533c742/dfs/data/data1/current/BP-1058142615-172.31.14.131-1689675022078] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-18 10:13:13,220 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c329d283-1f43-4a99-3860-7ed90b9830ca/cluster_838469a3-f099-4817-4d19-bba87533c742/dfs/data/data2/current/BP-1058142615-172.31.14.131-1689675022078] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-18 10:13:13,240 INFO [Listener at jenkins-hbase4.apache.org/34477] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-18 10:13:13,369 INFO [Listener at jenkins-hbase4.apache.org/34477] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-18 10:13:13,459 INFO [Listener at jenkins-hbase4.apache.org/34477] hbase.HBaseTestingUtility(1293): Minicluster is down