2023-10-01 19:01:18,163 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-10-01 19:01:18,368 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba 2023-10-01 19:01:18,368 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-10-01 19:01:18,369 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-10-01 19:01:18,409 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-10-01 19:01:18,667 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-10-01 19:01:18,668 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba/cluster_4acb6892-f4ef-d33f-00bc-9c8e7df86da3, deleteOnExit=true 2023-10-01 19:01:18,668 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-10-01 19:01:18,669 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba/test.cache.data in system properties and HBase conf 2023-10-01 19:01:18,669 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba/hadoop.tmp.dir in system properties and HBase conf 2023-10-01 19:01:18,670 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba/hadoop.log.dir in system properties and HBase conf 2023-10-01 19:01:18,670 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba/mapreduce.cluster.local.dir in system properties and HBase conf 2023-10-01 19:01:18,671 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-10-01 19:01:18,671 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-10-01 19:01:18,988 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-10-01 19:01:18,993 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-10-01 19:01:18,993 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-10-01 19:01:18,993 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-10-01 19:01:18,994 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-01 19:01:18,994 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-10-01 19:01:18,994 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-10-01 19:01:18,995 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-01 19:01:18,995 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-01 19:01:18,995 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-10-01 19:01:18,995 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba/nfs.dump.dir in system properties and HBase conf 2023-10-01 19:01:18,996 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba/java.io.tmpdir in system properties and HBase conf 2023-10-01 19:01:18,996 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-01 19:01:18,996 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-10-01 19:01:18,996 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-10-01 19:01:19,542 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-10-01 19:01:19,547 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-10-01 19:01:19,852 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-10-01 19:01:20,052 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-10-01 19:01:20,066 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-01 19:01:20,107 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-10-01 19:01:20,143 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba/java.io.tmpdir/Jetty_localhost_34065_hdfs____v1q1so/webapp 2023-10-01 19:01:20,273 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34065 2023-10-01 19:01:20,317 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-10-01 19:01:20,318 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-10-01 19:01:20,794 WARN [Listener at localhost/38933] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-01 19:01:20,874 WARN [Listener at localhost/38933] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-10-01 19:01:20,900 WARN [Listener at localhost/38933] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-01 19:01:20,909 INFO [Listener at localhost/38933] log.Slf4jLog(67): jetty-6.1.26 2023-10-01 19:01:20,915 INFO [Listener at localhost/38933] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba/java.io.tmpdir/Jetty_localhost_36617_datanode____.no0bnk/webapp 2023-10-01 19:01:21,019 INFO [Listener at localhost/38933] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36617 2023-10-01 19:01:21,484 WARN [Listener at localhost/34369] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-01 19:01:21,499 WARN [Listener at localhost/34369] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-10-01 19:01:21,502 WARN [Listener at localhost/34369] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-01 19:01:21,504 INFO [Listener at localhost/34369] log.Slf4jLog(67): jetty-6.1.26 2023-10-01 19:01:21,514 INFO [Listener at localhost/34369] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba/java.io.tmpdir/Jetty_localhost_37925_datanode____.r01a69/webapp 2023-10-01 19:01:21,623 INFO [Listener at localhost/34369] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37925 2023-10-01 19:01:21,632 WARN [Listener at localhost/37063] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-01 19:01:21,656 WARN [Listener at localhost/37063] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-10-01 19:01:21,658 WARN [Listener at localhost/37063] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-01 19:01:21,660 INFO [Listener at localhost/37063] log.Slf4jLog(67): jetty-6.1.26 2023-10-01 19:01:21,666 INFO [Listener at localhost/37063] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba/java.io.tmpdir/Jetty_localhost_46325_datanode____.3pgxlx/webapp 2023-10-01 19:01:21,791 INFO [Listener at localhost/37063] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46325 2023-10-01 19:01:21,801 WARN [Listener at localhost/37115] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-01 19:01:22,060 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc55c69eee5ba9c50: Processing first storage report for DS-45d56a32-d59e-4b22-a3b5-c3e164f8825e from datanode cbf73267-f011-4366-91ec-2a3433db4d22 2023-10-01 19:01:22,063 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc55c69eee5ba9c50: from storage DS-45d56a32-d59e-4b22-a3b5-c3e164f8825e node DatanodeRegistration(127.0.0.1:42365, datanodeUuid=cbf73267-f011-4366-91ec-2a3433db4d22, infoPort=35177, infoSecurePort=0, ipcPort=37063, storageInfo=lv=-57;cid=testClusterID;nsid=74017390;c=1696186879628), blocks: 0, hasStaleStorage: true, processing time: 3 msecs, invalidatedBlocks: 0 2023-10-01 19:01:22,063 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8eb00726be81d43: Processing first storage report for DS-1e3a6ce5-bdd9-4556-a298-97c185756a91 from datanode 5a52128c-050b-4ac0-8887-45c12863a58d 2023-10-01 19:01:22,063 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8eb00726be81d43: from storage DS-1e3a6ce5-bdd9-4556-a298-97c185756a91 node DatanodeRegistration(127.0.0.1:33829, datanodeUuid=5a52128c-050b-4ac0-8887-45c12863a58d, infoPort=40921, infoSecurePort=0, ipcPort=37115, storageInfo=lv=-57;cid=testClusterID;nsid=74017390;c=1696186879628), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-01 19:01:22,064 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x13ab2b030061d3ca: Processing first storage report for DS-d3a3653d-8bbd-4e54-b7ce-b178110bbe4f from datanode 7b92139c-413d-41f4-bfa4-697ef13e59cb 2023-10-01 19:01:22,064 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x13ab2b030061d3ca: from storage DS-d3a3653d-8bbd-4e54-b7ce-b178110bbe4f node DatanodeRegistration(127.0.0.1:38837, datanodeUuid=7b92139c-413d-41f4-bfa4-697ef13e59cb, infoPort=34801, infoSecurePort=0, ipcPort=34369, storageInfo=lv=-57;cid=testClusterID;nsid=74017390;c=1696186879628), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-01 19:01:22,064 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc55c69eee5ba9c50: Processing first storage report for DS-e98232b7-1064-4c4c-bba8-0db61e98ae32 from datanode cbf73267-f011-4366-91ec-2a3433db4d22 2023-10-01 19:01:22,064 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc55c69eee5ba9c50: from storage DS-e98232b7-1064-4c4c-bba8-0db61e98ae32 node DatanodeRegistration(127.0.0.1:42365, datanodeUuid=cbf73267-f011-4366-91ec-2a3433db4d22, infoPort=35177, infoSecurePort=0, ipcPort=37063, storageInfo=lv=-57;cid=testClusterID;nsid=74017390;c=1696186879628), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-01 19:01:22,064 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8eb00726be81d43: Processing first storage report for DS-b96d4a95-05c9-4fe4-ba34-ea08961526c4 from datanode 5a52128c-050b-4ac0-8887-45c12863a58d 2023-10-01 19:01:22,065 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8eb00726be81d43: from storage DS-b96d4a95-05c9-4fe4-ba34-ea08961526c4 node DatanodeRegistration(127.0.0.1:33829, datanodeUuid=5a52128c-050b-4ac0-8887-45c12863a58d, infoPort=40921, infoSecurePort=0, ipcPort=37115, storageInfo=lv=-57;cid=testClusterID;nsid=74017390;c=1696186879628), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-01 19:01:22,065 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x13ab2b030061d3ca: Processing first storage report for DS-96f267dc-ae0c-4957-92d3-e84c912efd93 from datanode 7b92139c-413d-41f4-bfa4-697ef13e59cb 2023-10-01 19:01:22,065 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x13ab2b030061d3ca: from storage DS-96f267dc-ae0c-4957-92d3-e84c912efd93 node DatanodeRegistration(127.0.0.1:38837, datanodeUuid=7b92139c-413d-41f4-bfa4-697ef13e59cb, infoPort=34801, infoSecurePort=0, ipcPort=34369, storageInfo=lv=-57;cid=testClusterID;nsid=74017390;c=1696186879628), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-01 19:01:22,292 DEBUG [Listener at localhost/37115] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba 2023-10-01 19:01:22,377 INFO [Listener at localhost/37115] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba/cluster_4acb6892-f4ef-d33f-00bc-9c8e7df86da3/zookeeper_0, clientPort=55462, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba/cluster_4acb6892-f4ef-d33f-00bc-9c8e7df86da3/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba/cluster_4acb6892-f4ef-d33f-00bc-9c8e7df86da3/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-10-01 19:01:22,402 INFO [Listener at localhost/37115] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=55462 2023-10-01 19:01:22,413 INFO [Listener at localhost/37115] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-01 19:01:22,414 INFO [Listener at localhost/37115] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-01 19:01:23,104 INFO [Listener at localhost/37115] util.FSUtils(471): Created version file at hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399 with version=8 2023-10-01 19:01:23,104 INFO [Listener at localhost/37115] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/hbase-staging 2023-10-01 19:01:23,542 INFO [Listener at localhost/37115] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-10-01 19:01:24,002 INFO [Listener at localhost/37115] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-10-01 19:01:24,035 INFO [Listener at localhost/37115] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-01 19:01:24,035 INFO [Listener at localhost/37115] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-01 19:01:24,036 INFO [Listener at localhost/37115] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-01 19:01:24,036 INFO [Listener at localhost/37115] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-01 19:01:24,036 INFO [Listener at localhost/37115] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-01 19:01:24,178 INFO [Listener at localhost/37115] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-10-01 19:01:24,250 DEBUG [Listener at localhost/37115] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-10-01 19:01:24,342 INFO [Listener at localhost/37115] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42819 2023-10-01 19:01:24,355 INFO [Listener at localhost/37115] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-01 19:01:24,358 INFO [Listener at localhost/37115] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-01 19:01:24,385 INFO [Listener at localhost/37115] zookeeper.RecoverableZooKeeper(93): Process identifier=master:42819 connecting to ZooKeeper ensemble=127.0.0.1:55462 2023-10-01 19:01:24,437 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:428190x0, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-01 19:01:24,440 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:42819-0x101035d10db0000 connected 2023-10-01 19:01:24,472 DEBUG [Listener at localhost/37115] zookeeper.ZKUtil(164): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-01 19:01:24,473 DEBUG [Listener at localhost/37115] zookeeper.ZKUtil(164): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-01 19:01:24,486 DEBUG [Listener at localhost/37115] zookeeper.ZKUtil(164): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-01 19:01:24,494 DEBUG [Listener at localhost/37115] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42819 2023-10-01 19:01:24,494 DEBUG [Listener at localhost/37115] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42819 2023-10-01 19:01:24,495 DEBUG [Listener at localhost/37115] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42819 2023-10-01 19:01:24,495 DEBUG [Listener at localhost/37115] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42819 2023-10-01 19:01:24,497 DEBUG [Listener at localhost/37115] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42819 2023-10-01 19:01:24,503 INFO [Listener at localhost/37115] master.HMaster(444): hbase.rootdir=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399, hbase.cluster.distributed=false 2023-10-01 19:01:24,567 INFO [Listener at localhost/37115] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-10-01 19:01:24,567 INFO [Listener at localhost/37115] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-01 19:01:24,567 INFO [Listener at localhost/37115] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-01 19:01:24,567 INFO [Listener at localhost/37115] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-01 19:01:24,568 INFO [Listener at localhost/37115] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-01 19:01:24,568 INFO [Listener at localhost/37115] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-01 19:01:24,572 INFO [Listener at localhost/37115] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-10-01 19:01:24,575 INFO [Listener at localhost/37115] ipc.NettyRpcServer(120): Bind to /172.31.14.131:46609 2023-10-01 19:01:24,578 INFO [Listener at localhost/37115] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-10-01 19:01:24,586 INFO [Listener at localhost/37115] mob.MobFileCache(125): MobFileCache disabled 2023-10-01 19:01:24,587 INFO [Listener at localhost/37115] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-01 19:01:24,589 INFO [Listener at localhost/37115] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-01 19:01:24,591 INFO [Listener at localhost/37115] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:46609 connecting to ZooKeeper ensemble=127.0.0.1:55462 2023-10-01 19:01:24,594 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:466090x0, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-01 19:01:24,595 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:46609-0x101035d10db0001 connected 2023-10-01 19:01:24,595 DEBUG [Listener at localhost/37115] zookeeper.ZKUtil(164): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-01 19:01:24,597 DEBUG [Listener at localhost/37115] zookeeper.ZKUtil(164): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-01 19:01:24,598 DEBUG [Listener at localhost/37115] zookeeper.ZKUtil(164): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-01 19:01:24,598 DEBUG [Listener at localhost/37115] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46609 2023-10-01 19:01:24,598 DEBUG [Listener at localhost/37115] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46609 2023-10-01 19:01:24,600 DEBUG [Listener at localhost/37115] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46609 2023-10-01 19:01:24,600 DEBUG [Listener at localhost/37115] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46609 2023-10-01 19:01:24,600 DEBUG [Listener at localhost/37115] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46609 2023-10-01 19:01:24,613 INFO [Listener at localhost/37115] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-10-01 19:01:24,613 INFO [Listener at localhost/37115] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-01 19:01:24,613 INFO [Listener at localhost/37115] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-01 19:01:24,614 INFO [Listener at localhost/37115] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-01 19:01:24,614 INFO [Listener at localhost/37115] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-01 19:01:24,614 INFO [Listener at localhost/37115] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-01 19:01:24,614 INFO [Listener at localhost/37115] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-10-01 19:01:24,616 INFO [Listener at localhost/37115] ipc.NettyRpcServer(120): Bind to /172.31.14.131:36507 2023-10-01 19:01:24,616 INFO [Listener at localhost/37115] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-10-01 19:01:24,618 INFO [Listener at localhost/37115] mob.MobFileCache(125): MobFileCache disabled 2023-10-01 19:01:24,619 INFO [Listener at localhost/37115] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-01 19:01:24,620 INFO [Listener at localhost/37115] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-01 19:01:24,622 INFO [Listener at localhost/37115] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:36507 connecting to ZooKeeper ensemble=127.0.0.1:55462 2023-10-01 19:01:24,628 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:365070x0, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-01 19:01:24,629 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:36507-0x101035d10db0002 connected 2023-10-01 19:01:24,629 DEBUG [Listener at localhost/37115] zookeeper.ZKUtil(164): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-01 19:01:24,630 DEBUG [Listener at localhost/37115] zookeeper.ZKUtil(164): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-01 19:01:24,631 DEBUG [Listener at localhost/37115] zookeeper.ZKUtil(164): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-01 19:01:24,631 DEBUG [Listener at localhost/37115] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36507 2023-10-01 19:01:24,632 DEBUG [Listener at localhost/37115] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36507 2023-10-01 19:01:24,633 DEBUG [Listener at localhost/37115] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36507 2023-10-01 19:01:24,637 DEBUG [Listener at localhost/37115] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36507 2023-10-01 19:01:24,637 DEBUG [Listener at localhost/37115] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36507 2023-10-01 19:01:24,649 INFO [Listener at localhost/37115] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-10-01 19:01:24,649 INFO [Listener at localhost/37115] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-01 19:01:24,649 INFO [Listener at localhost/37115] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-01 19:01:24,650 INFO [Listener at localhost/37115] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-01 19:01:24,650 INFO [Listener at localhost/37115] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-01 19:01:24,650 INFO [Listener at localhost/37115] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-01 19:01:24,650 INFO [Listener at localhost/37115] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-10-01 19:01:24,651 INFO [Listener at localhost/37115] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44933 2023-10-01 19:01:24,652 INFO [Listener at localhost/37115] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-10-01 19:01:24,653 INFO [Listener at localhost/37115] mob.MobFileCache(125): MobFileCache disabled 2023-10-01 19:01:24,654 INFO [Listener at localhost/37115] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-01 19:01:24,656 INFO [Listener at localhost/37115] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-01 19:01:24,659 INFO [Listener at localhost/37115] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44933 connecting to ZooKeeper ensemble=127.0.0.1:55462 2023-10-01 19:01:24,662 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:449330x0, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-01 19:01:24,663 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:44933-0x101035d10db0003 connected 2023-10-01 19:01:24,663 DEBUG [Listener at localhost/37115] zookeeper.ZKUtil(164): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-01 19:01:24,664 DEBUG [Listener at localhost/37115] zookeeper.ZKUtil(164): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-01 19:01:24,665 DEBUG [Listener at localhost/37115] zookeeper.ZKUtil(164): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-01 19:01:24,669 DEBUG [Listener at localhost/37115] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44933 2023-10-01 19:01:24,669 DEBUG [Listener at localhost/37115] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44933 2023-10-01 19:01:24,669 DEBUG [Listener at localhost/37115] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44933 2023-10-01 19:01:24,673 DEBUG [Listener at localhost/37115] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44933 2023-10-01 19:01:24,673 DEBUG [Listener at localhost/37115] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44933 2023-10-01 19:01:24,675 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,42819,1696186883324 2023-10-01 19:01:24,685 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-10-01 19:01:24,686 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,42819,1696186883324 2023-10-01 19:01:24,705 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-01 19:01:24,705 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-01 19:01:24,705 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-01 19:01:24,705 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-01 19:01:24,705 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-01 19:01:24,707 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-10-01 19:01:24,708 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,42819,1696186883324 from backup master directory 2023-10-01 19:01:24,708 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-10-01 19:01:24,713 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,42819,1696186883324 2023-10-01 19:01:24,713 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-10-01 19:01:24,714 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-01 19:01:24,714 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,42819,1696186883324 2023-10-01 19:01:24,717 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-10-01 19:01:24,719 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-10-01 19:01:24,812 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/hbase.id with ID: 09a0e50e-25e6-4002-bd7a-d6fbd6d4b95f 2023-10-01 19:01:24,857 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-01 19:01:24,877 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-01 19:01:24,939 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x79c951d0 to 127.0.0.1:55462 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 19:01:24,973 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6cf7c466, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 19:01:24,997 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-10-01 19:01:25,000 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-10-01 19:01:25,020 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-10-01 19:01:25,020 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-10-01 19:01:25,022 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-10-01 19:01:25,026 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-10-01 19:01:25,027 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-01 19:01:25,063 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/MasterData/data/master/store-tmp 2023-10-01 19:01:25,101 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 19:01:25,102 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-10-01 19:01:25,102 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-01 19:01:25,102 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-01 19:01:25,102 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-10-01 19:01:25,102 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-01 19:01:25,102 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-01 19:01:25,102 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-10-01 19:01:25,104 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/MasterData/WALs/jenkins-hbase4.apache.org,42819,1696186883324 2023-10-01 19:01:25,125 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42819%2C1696186883324, suffix=, logDir=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/MasterData/WALs/jenkins-hbase4.apache.org,42819,1696186883324, archiveDir=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/MasterData/oldWALs, maxLogs=10 2023-10-01 19:01:25,189 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38837,DS-d3a3653d-8bbd-4e54-b7ce-b178110bbe4f,DISK] 2023-10-01 19:01:25,189 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33829,DS-1e3a6ce5-bdd9-4556-a298-97c185756a91,DISK] 2023-10-01 19:01:25,189 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42365,DS-45d56a32-d59e-4b22-a3b5-c3e164f8825e,DISK] 2023-10-01 19:01:25,198 DEBUG [RS-EventLoopGroup-5-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-10-01 19:01:25,262 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/MasterData/WALs/jenkins-hbase4.apache.org,42819,1696186883324/jenkins-hbase4.apache.org%2C42819%2C1696186883324.1696186885136 2023-10-01 19:01:25,262 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38837,DS-d3a3653d-8bbd-4e54-b7ce-b178110bbe4f,DISK], DatanodeInfoWithStorage[127.0.0.1:42365,DS-45d56a32-d59e-4b22-a3b5-c3e164f8825e,DISK], DatanodeInfoWithStorage[127.0.0.1:33829,DS-1e3a6ce5-bdd9-4556-a298-97c185756a91,DISK]] 2023-10-01 19:01:25,263 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-10-01 19:01:25,263 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 19:01:25,267 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-10-01 19:01:25,268 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-10-01 19:01:25,338 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-10-01 19:01:25,344 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-10-01 19:01:25,372 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-10-01 19:01:25,384 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 19:01:25,391 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-10-01 19:01:25,393 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-10-01 19:01:25,407 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-10-01 19:01:25,411 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-01 19:01:25,412 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59335681, jitterRate=-0.1158294528722763}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-01 19:01:25,412 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-10-01 19:01:25,413 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-10-01 19:01:25,438 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-10-01 19:01:25,439 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(561): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-10-01 19:01:25,443 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-10-01 19:01:25,445 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(581): Recovered RegionProcedureStore lease in 1 msec 2023-10-01 19:01:25,484 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(595): Loaded RegionProcedureStore in 38 msec 2023-10-01 19:01:25,484 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-10-01 19:01:25,515 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-10-01 19:01:25,521 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-10-01 19:01:25,545 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-10-01 19:01:25,550 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-10-01 19:01:25,552 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-10-01 19:01:25,557 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-10-01 19:01:25,561 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-10-01 19:01:25,565 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-01 19:01:25,566 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-10-01 19:01:25,567 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-10-01 19:01:25,585 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-10-01 19:01:25,589 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-01 19:01:25,589 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-01 19:01:25,589 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-01 19:01:25,589 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-01 19:01:25,590 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-01 19:01:25,590 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,42819,1696186883324, sessionid=0x101035d10db0000, setting cluster-up flag (Was=false) 2023-10-01 19:01:25,608 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-01 19:01:25,613 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-10-01 19:01:25,615 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,42819,1696186883324 2023-10-01 19:01:25,621 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-01 19:01:25,627 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-10-01 19:01:25,629 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,42819,1696186883324 2023-10-01 19:01:25,632 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(304): Couldn't delete working snapshot directory: hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/.tmp 2023-10-01 19:01:25,678 INFO [RS:1;jenkins-hbase4:36507] regionserver.HRegionServer(951): ClusterId : 09a0e50e-25e6-4002-bd7a-d6fbd6d4b95f 2023-10-01 19:01:25,678 INFO [RS:0;jenkins-hbase4:46609] regionserver.HRegionServer(951): ClusterId : 09a0e50e-25e6-4002-bd7a-d6fbd6d4b95f 2023-10-01 19:01:25,679 INFO [RS:2;jenkins-hbase4:44933] regionserver.HRegionServer(951): ClusterId : 09a0e50e-25e6-4002-bd7a-d6fbd6d4b95f 2023-10-01 19:01:25,686 DEBUG [RS:1;jenkins-hbase4:36507] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-10-01 19:01:25,686 DEBUG [RS:2;jenkins-hbase4:44933] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-10-01 19:01:25,686 DEBUG [RS:0;jenkins-hbase4:46609] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-10-01 19:01:25,692 DEBUG [RS:1;jenkins-hbase4:36507] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-10-01 19:01:25,692 DEBUG [RS:0;jenkins-hbase4:46609] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-10-01 19:01:25,692 DEBUG [RS:2;jenkins-hbase4:44933] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-10-01 19:01:25,693 DEBUG [RS:0;jenkins-hbase4:46609] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-10-01 19:01:25,693 DEBUG [RS:1;jenkins-hbase4:36507] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-10-01 19:01:25,693 DEBUG [RS:2;jenkins-hbase4:44933] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-10-01 19:01:25,698 DEBUG [RS:0;jenkins-hbase4:46609] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-10-01 19:01:25,700 DEBUG [RS:0;jenkins-hbase4:46609] zookeeper.ReadOnlyZKClient(139): Connect 0x61706be8 to 127.0.0.1:55462 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 19:01:25,701 DEBUG [RS:1;jenkins-hbase4:36507] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-10-01 19:01:25,708 DEBUG [RS:2;jenkins-hbase4:44933] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-10-01 19:01:25,711 DEBUG [RS:1;jenkins-hbase4:36507] zookeeper.ReadOnlyZKClient(139): Connect 0x34a97217 to 127.0.0.1:55462 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 19:01:25,711 DEBUG [RS:2;jenkins-hbase4:44933] zookeeper.ReadOnlyZKClient(139): Connect 0x36b1263b to 127.0.0.1:55462 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 19:01:25,719 DEBUG [RS:0;jenkins-hbase4:46609] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6fb789b6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 19:01:25,719 DEBUG [RS:0;jenkins-hbase4:46609] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6b880098, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-10-01 19:01:25,721 DEBUG [RS:1;jenkins-hbase4:36507] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3a6e9af2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 19:01:25,721 DEBUG [RS:1;jenkins-hbase4:36507] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3e511967, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-10-01 19:01:25,723 DEBUG [RS:2;jenkins-hbase4:44933] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3876ce9d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 19:01:25,724 DEBUG [RS:2;jenkins-hbase4:44933] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3c494d4b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-10-01 19:01:25,746 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-10-01 19:01:25,749 DEBUG [RS:1;jenkins-hbase4:36507] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:36507 2023-10-01 19:01:25,749 DEBUG [RS:0;jenkins-hbase4:46609] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:46609 2023-10-01 19:01:25,749 DEBUG [RS:2;jenkins-hbase4:44933] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:44933 2023-10-01 19:01:25,752 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 19:01:25,752 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-10-01 19:01:25,756 INFO [RS:1;jenkins-hbase4:36507] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-10-01 19:01:25,756 INFO [RS:2;jenkins-hbase4:44933] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-10-01 19:01:25,757 INFO [RS:2;jenkins-hbase4:44933] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-10-01 19:01:25,756 INFO [RS:0;jenkins-hbase4:46609] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-10-01 19:01:25,757 INFO [RS:1;jenkins-hbase4:36507] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-10-01 19:01:25,757 INFO [RS:0;jenkins-hbase4:46609] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-10-01 19:01:25,758 DEBUG [RS:1;jenkins-hbase4:36507] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-10-01 19:01:25,758 DEBUG [RS:0;jenkins-hbase4:46609] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-10-01 19:01:25,758 DEBUG [RS:2;jenkins-hbase4:44933] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-10-01 19:01:25,758 INFO [RS:0;jenkins-hbase4:46609] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 19:01:25,759 INFO [RS:1;jenkins-hbase4:36507] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 19:01:25,759 DEBUG [RS:1;jenkins-hbase4:36507] regionserver.HRegionServer(1022): About to register with Master. 2023-10-01 19:01:25,758 INFO [RS:2;jenkins-hbase4:44933] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 19:01:25,759 DEBUG [RS:0;jenkins-hbase4:46609] regionserver.HRegionServer(1022): About to register with Master. 2023-10-01 19:01:25,759 DEBUG [RS:2;jenkins-hbase4:44933] regionserver.HRegionServer(1022): About to register with Master. 2023-10-01 19:01:25,762 INFO [RS:2;jenkins-hbase4:44933] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,42819,1696186883324 with isa=jenkins-hbase4.apache.org/172.31.14.131:44933, startcode=1696186884649 2023-10-01 19:01:25,762 INFO [RS:1;jenkins-hbase4:36507] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,42819,1696186883324 with isa=jenkins-hbase4.apache.org/172.31.14.131:36507, startcode=1696186884612 2023-10-01 19:01:25,762 INFO [RS:0;jenkins-hbase4:46609] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,42819,1696186883324 with isa=jenkins-hbase4.apache.org/172.31.14.131:46609, startcode=1696186884566 2023-10-01 19:01:25,784 DEBUG [RS:0;jenkins-hbase4:46609] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-10-01 19:01:25,784 DEBUG [RS:2;jenkins-hbase4:44933] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-10-01 19:01:25,784 DEBUG [RS:1;jenkins-hbase4:36507] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-10-01 19:01:25,857 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-10-01 19:01:25,857 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59041, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-10-01 19:01:25,857 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58941, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-10-01 19:01:25,857 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57929, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-10-01 19:01:25,866 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42819] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-10-01 19:01:25,869 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-10-01 19:01:25,869 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-10-01 19:01:25,869 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-10-01 19:01:25,869 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-10-01 19:01:25,870 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-10-01 19:01:25,870 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 19:01:25,870 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-10-01 19:01:25,870 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 19:01:25,880 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42819] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-10-01 19:01:25,881 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1696186915881 2023-10-01 19:01:25,882 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42819] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-10-01 19:01:25,886 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-10-01 19:01:25,892 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-10-01 19:01:25,893 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-10-01 19:01:25,898 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-10-01 19:01:25,899 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-10-01 19:01:25,904 DEBUG [RS:0;jenkins-hbase4:46609] regionserver.HRegionServer(2830): Master is not running yet 2023-10-01 19:01:25,905 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-10-01 19:01:25,905 WARN [RS:0;jenkins-hbase4:46609] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-10-01 19:01:25,904 DEBUG [RS:2;jenkins-hbase4:44933] regionserver.HRegionServer(2830): Master is not running yet 2023-10-01 19:01:25,904 DEBUG [RS:1;jenkins-hbase4:36507] regionserver.HRegionServer(2830): Master is not running yet 2023-10-01 19:01:25,905 WARN [RS:2;jenkins-hbase4:44933] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-10-01 19:01:25,905 WARN [RS:1;jenkins-hbase4:36507] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-10-01 19:01:25,906 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-10-01 19:01:25,906 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-10-01 19:01:25,906 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-10-01 19:01:25,907 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-10-01 19:01:25,909 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-10-01 19:01:25,911 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-10-01 19:01:25,912 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-10-01 19:01:25,915 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-10-01 19:01:25,916 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-10-01 19:01:25,918 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1696186885918,5,FailOnTimeoutGroup] 2023-10-01 19:01:25,919 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1696186885918,5,FailOnTimeoutGroup] 2023-10-01 19:01:25,919 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-10-01 19:01:25,919 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-10-01 19:01:25,920 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-10-01 19:01:25,920 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-10-01 19:01:25,943 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-10-01 19:01:25,945 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-10-01 19:01:25,945 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399 2023-10-01 19:01:25,969 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 19:01:25,971 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-10-01 19:01:25,974 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/hbase/meta/1588230740/info 2023-10-01 19:01:25,975 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-10-01 19:01:25,976 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 19:01:25,976 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-10-01 19:01:25,979 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/hbase/meta/1588230740/rep_barrier 2023-10-01 19:01:25,979 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-10-01 19:01:25,980 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 19:01:25,980 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-10-01 19:01:25,982 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/hbase/meta/1588230740/table 2023-10-01 19:01:25,983 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-10-01 19:01:25,984 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 19:01:25,985 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/hbase/meta/1588230740 2023-10-01 19:01:25,986 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/hbase/meta/1588230740 2023-10-01 19:01:25,990 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-10-01 19:01:25,992 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-10-01 19:01:25,996 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-01 19:01:25,996 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60965653, jitterRate=-0.09154097735881805}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-10-01 19:01:25,996 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-10-01 19:01:25,996 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-10-01 19:01:25,997 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-10-01 19:01:25,997 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-10-01 19:01:25,997 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-10-01 19:01:25,997 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-10-01 19:01:25,998 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-10-01 19:01:25,999 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-10-01 19:01:26,005 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-10-01 19:01:26,005 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-10-01 19:01:26,006 INFO [RS:0;jenkins-hbase4:46609] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,42819,1696186883324 with isa=jenkins-hbase4.apache.org/172.31.14.131:46609, startcode=1696186884566 2023-10-01 19:01:26,006 INFO [RS:2;jenkins-hbase4:44933] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,42819,1696186883324 with isa=jenkins-hbase4.apache.org/172.31.14.131:44933, startcode=1696186884649 2023-10-01 19:01:26,007 INFO [RS:1;jenkins-hbase4:36507] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,42819,1696186883324 with isa=jenkins-hbase4.apache.org/172.31.14.131:36507, startcode=1696186884612 2023-10-01 19:01:26,012 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42819] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:01:26,016 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-10-01 19:01:26,018 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42819] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:01:26,020 DEBUG [RS:2;jenkins-hbase4:44933] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399 2023-10-01 19:01:26,020 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42819] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:01:26,020 DEBUG [RS:2;jenkins-hbase4:44933] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:38933 2023-10-01 19:01:26,020 DEBUG [RS:2;jenkins-hbase4:44933] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-10-01 19:01:26,020 DEBUG [RS:1;jenkins-hbase4:36507] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399 2023-10-01 19:01:26,020 DEBUG [RS:1;jenkins-hbase4:36507] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:38933 2023-10-01 19:01:26,020 DEBUG [RS:1;jenkins-hbase4:36507] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-10-01 19:01:26,022 DEBUG [RS:0;jenkins-hbase4:46609] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399 2023-10-01 19:01:26,022 DEBUG [RS:0;jenkins-hbase4:46609] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:38933 2023-10-01 19:01:26,022 DEBUG [RS:0;jenkins-hbase4:46609] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-10-01 19:01:26,031 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-01 19:01:26,032 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-10-01 19:01:26,032 DEBUG [RS:0;jenkins-hbase4:46609] zookeeper.ZKUtil(162): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:01:26,033 WARN [RS:0;jenkins-hbase4:46609] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-01 19:01:26,033 DEBUG [RS:2;jenkins-hbase4:44933] zookeeper.ZKUtil(162): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:01:26,033 INFO [RS:0;jenkins-hbase4:46609] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-01 19:01:26,034 DEBUG [RS:1;jenkins-hbase4:36507] zookeeper.ZKUtil(162): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:01:26,034 DEBUG [RS:0;jenkins-hbase4:46609] regionserver.HRegionServer(1948): logDir=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/WALs/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:01:26,033 WARN [RS:2;jenkins-hbase4:44933] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-01 19:01:26,034 WARN [RS:1;jenkins-hbase4:36507] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-01 19:01:26,034 INFO [RS:2;jenkins-hbase4:44933] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-01 19:01:26,035 INFO [RS:1;jenkins-hbase4:36507] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-01 19:01:26,035 DEBUG [RS:2;jenkins-hbase4:44933] regionserver.HRegionServer(1948): logDir=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/WALs/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:01:26,035 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,44933,1696186884649] 2023-10-01 19:01:26,035 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,46609,1696186884566] 2023-10-01 19:01:26,035 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,36507,1696186884612] 2023-10-01 19:01:26,035 DEBUG [RS:1;jenkins-hbase4:36507] regionserver.HRegionServer(1948): logDir=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/WALs/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:01:26,045 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-10-01 19:01:26,055 DEBUG [RS:2;jenkins-hbase4:44933] zookeeper.ZKUtil(162): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:01:26,055 DEBUG [RS:1;jenkins-hbase4:36507] zookeeper.ZKUtil(162): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:01:26,055 DEBUG [RS:0;jenkins-hbase4:46609] zookeeper.ZKUtil(162): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:01:26,055 DEBUG [RS:2;jenkins-hbase4:44933] zookeeper.ZKUtil(162): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:01:26,056 DEBUG [RS:1;jenkins-hbase4:36507] zookeeper.ZKUtil(162): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:01:26,056 DEBUG [RS:0;jenkins-hbase4:46609] zookeeper.ZKUtil(162): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:01:26,056 DEBUG [RS:2;jenkins-hbase4:44933] zookeeper.ZKUtil(162): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:01:26,056 DEBUG [RS:1;jenkins-hbase4:36507] zookeeper.ZKUtil(162): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:01:26,056 DEBUG [RS:0;jenkins-hbase4:46609] zookeeper.ZKUtil(162): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:01:26,070 DEBUG [RS:1;jenkins-hbase4:36507] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-10-01 19:01:26,070 DEBUG [RS:2;jenkins-hbase4:44933] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-10-01 19:01:26,070 DEBUG [RS:0;jenkins-hbase4:46609] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-10-01 19:01:26,081 INFO [RS:1;jenkins-hbase4:36507] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-10-01 19:01:26,081 INFO [RS:0;jenkins-hbase4:46609] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-10-01 19:01:26,081 INFO [RS:2;jenkins-hbase4:44933] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-10-01 19:01:26,104 INFO [RS:1;jenkins-hbase4:36507] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-10-01 19:01:26,104 INFO [RS:2;jenkins-hbase4:44933] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-10-01 19:01:26,104 INFO [RS:0;jenkins-hbase4:46609] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-10-01 19:01:26,109 INFO [RS:1;jenkins-hbase4:36507] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-01 19:01:26,109 INFO [RS:0;jenkins-hbase4:46609] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-01 19:01:26,109 INFO [RS:2;jenkins-hbase4:44933] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-01 19:01:26,110 INFO [RS:0;jenkins-hbase4:46609] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-01 19:01:26,109 INFO [RS:1;jenkins-hbase4:36507] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-01 19:01:26,110 INFO [RS:2;jenkins-hbase4:44933] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-01 19:01:26,111 INFO [RS:0;jenkins-hbase4:46609] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-10-01 19:01:26,111 INFO [RS:1;jenkins-hbase4:36507] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-10-01 19:01:26,111 INFO [RS:2;jenkins-hbase4:44933] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-10-01 19:01:26,120 INFO [RS:1;jenkins-hbase4:36507] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-10-01 19:01:26,120 INFO [RS:2;jenkins-hbase4:44933] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-10-01 19:01:26,120 INFO [RS:0;jenkins-hbase4:46609] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-10-01 19:01:26,121 DEBUG [RS:1;jenkins-hbase4:36507] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 19:01:26,121 DEBUG [RS:2;jenkins-hbase4:44933] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 19:01:26,121 DEBUG [RS:1;jenkins-hbase4:36507] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 19:01:26,121 DEBUG [RS:2;jenkins-hbase4:44933] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 19:01:26,121 DEBUG [RS:1;jenkins-hbase4:36507] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 19:01:26,121 DEBUG [RS:2;jenkins-hbase4:44933] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 19:01:26,121 DEBUG [RS:1;jenkins-hbase4:36507] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 19:01:26,121 DEBUG [RS:2;jenkins-hbase4:44933] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 19:01:26,122 DEBUG [RS:1;jenkins-hbase4:36507] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 19:01:26,122 DEBUG [RS:2;jenkins-hbase4:44933] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 19:01:26,122 DEBUG [RS:1;jenkins-hbase4:36507] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-10-01 19:01:26,122 DEBUG [RS:2;jenkins-hbase4:44933] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-10-01 19:01:26,122 DEBUG [RS:1;jenkins-hbase4:36507] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 19:01:26,122 DEBUG [RS:2;jenkins-hbase4:44933] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 19:01:26,121 DEBUG [RS:0;jenkins-hbase4:46609] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 19:01:26,122 DEBUG [RS:2;jenkins-hbase4:44933] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 19:01:26,122 DEBUG [RS:1;jenkins-hbase4:36507] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 19:01:26,122 DEBUG [RS:2;jenkins-hbase4:44933] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 19:01:26,122 DEBUG [RS:1;jenkins-hbase4:36507] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 19:01:26,122 DEBUG [RS:2;jenkins-hbase4:44933] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 19:01:26,122 DEBUG [RS:1;jenkins-hbase4:36507] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 19:01:26,122 DEBUG [RS:0;jenkins-hbase4:46609] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 19:01:26,122 DEBUG [RS:0;jenkins-hbase4:46609] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 19:01:26,123 DEBUG [RS:0;jenkins-hbase4:46609] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 19:01:26,123 DEBUG [RS:0;jenkins-hbase4:46609] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 19:01:26,123 DEBUG [RS:0;jenkins-hbase4:46609] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-10-01 19:01:26,124 DEBUG [RS:0;jenkins-hbase4:46609] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 19:01:26,124 DEBUG [RS:0;jenkins-hbase4:46609] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 19:01:26,124 DEBUG [RS:0;jenkins-hbase4:46609] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 19:01:26,124 DEBUG [RS:0;jenkins-hbase4:46609] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 19:01:26,125 INFO [RS:2;jenkins-hbase4:44933] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-10-01 19:01:26,125 INFO [RS:2;jenkins-hbase4:44933] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-10-01 19:01:26,125 INFO [RS:2;jenkins-hbase4:44933] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-10-01 19:01:26,128 INFO [RS:1;jenkins-hbase4:36507] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-10-01 19:01:26,129 INFO [RS:1;jenkins-hbase4:36507] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-10-01 19:01:26,129 INFO [RS:0;jenkins-hbase4:46609] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-10-01 19:01:26,129 INFO [RS:1;jenkins-hbase4:36507] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-10-01 19:01:26,129 INFO [RS:0;jenkins-hbase4:46609] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-10-01 19:01:26,130 INFO [RS:0;jenkins-hbase4:46609] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-10-01 19:01:26,148 INFO [RS:1;jenkins-hbase4:36507] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-10-01 19:01:26,148 INFO [RS:2;jenkins-hbase4:44933] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-10-01 19:01:26,148 INFO [RS:0;jenkins-hbase4:46609] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-10-01 19:01:26,152 INFO [RS:1;jenkins-hbase4:36507] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36507,1696186884612-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-01 19:01:26,152 INFO [RS:0;jenkins-hbase4:46609] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46609,1696186884566-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-01 19:01:26,152 INFO [RS:2;jenkins-hbase4:44933] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44933,1696186884649-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-01 19:01:26,172 INFO [RS:1;jenkins-hbase4:36507] regionserver.Replication(203): jenkins-hbase4.apache.org,36507,1696186884612 started 2023-10-01 19:01:26,172 INFO [RS:1;jenkins-hbase4:36507] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,36507,1696186884612, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:36507, sessionid=0x101035d10db0002 2023-10-01 19:01:26,172 DEBUG [RS:1;jenkins-hbase4:36507] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-10-01 19:01:26,172 DEBUG [RS:1;jenkins-hbase4:36507] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:01:26,172 DEBUG [RS:1;jenkins-hbase4:36507] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36507,1696186884612' 2023-10-01 19:01:26,172 DEBUG [RS:1;jenkins-hbase4:36507] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-01 19:01:26,173 DEBUG [RS:1;jenkins-hbase4:36507] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-01 19:01:26,174 DEBUG [RS:1;jenkins-hbase4:36507] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-10-01 19:01:26,174 DEBUG [RS:1;jenkins-hbase4:36507] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-10-01 19:01:26,174 DEBUG [RS:1;jenkins-hbase4:36507] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:01:26,174 DEBUG [RS:1;jenkins-hbase4:36507] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36507,1696186884612' 2023-10-01 19:01:26,174 DEBUG [RS:1;jenkins-hbase4:36507] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 19:01:26,175 DEBUG [RS:1;jenkins-hbase4:36507] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 19:01:26,175 INFO [RS:0;jenkins-hbase4:46609] regionserver.Replication(203): jenkins-hbase4.apache.org,46609,1696186884566 started 2023-10-01 19:01:26,175 INFO [RS:0;jenkins-hbase4:46609] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,46609,1696186884566, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:46609, sessionid=0x101035d10db0001 2023-10-01 19:01:26,175 DEBUG [RS:1;jenkins-hbase4:36507] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-10-01 19:01:26,175 DEBUG [RS:0;jenkins-hbase4:46609] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-10-01 19:01:26,175 INFO [RS:1;jenkins-hbase4:36507] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-10-01 19:01:26,176 DEBUG [RS:0;jenkins-hbase4:46609] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:01:26,176 INFO [RS:1;jenkins-hbase4:36507] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-10-01 19:01:26,177 DEBUG [RS:0;jenkins-hbase4:46609] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46609,1696186884566' 2023-10-01 19:01:26,177 DEBUG [RS:0;jenkins-hbase4:46609] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-01 19:01:26,178 DEBUG [RS:0;jenkins-hbase4:46609] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-01 19:01:26,178 DEBUG [RS:0;jenkins-hbase4:46609] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-10-01 19:01:26,179 DEBUG [RS:0;jenkins-hbase4:46609] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-10-01 19:01:26,179 DEBUG [RS:0;jenkins-hbase4:46609] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:01:26,180 DEBUG [RS:0;jenkins-hbase4:46609] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46609,1696186884566' 2023-10-01 19:01:26,180 DEBUG [RS:0;jenkins-hbase4:46609] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 19:01:26,181 DEBUG [RS:0;jenkins-hbase4:46609] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 19:01:26,181 DEBUG [RS:0;jenkins-hbase4:46609] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-10-01 19:01:26,181 INFO [RS:0;jenkins-hbase4:46609] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-10-01 19:01:26,181 INFO [RS:0;jenkins-hbase4:46609] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-10-01 19:01:26,182 INFO [RS:2;jenkins-hbase4:44933] regionserver.Replication(203): jenkins-hbase4.apache.org,44933,1696186884649 started 2023-10-01 19:01:26,183 INFO [RS:2;jenkins-hbase4:44933] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,44933,1696186884649, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:44933, sessionid=0x101035d10db0003 2023-10-01 19:01:26,183 DEBUG [RS:2;jenkins-hbase4:44933] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-10-01 19:01:26,183 DEBUG [RS:2;jenkins-hbase4:44933] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:01:26,183 DEBUG [RS:2;jenkins-hbase4:44933] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44933,1696186884649' 2023-10-01 19:01:26,183 DEBUG [RS:2;jenkins-hbase4:44933] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-01 19:01:26,183 DEBUG [RS:2;jenkins-hbase4:44933] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-01 19:01:26,184 DEBUG [RS:2;jenkins-hbase4:44933] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-10-01 19:01:26,184 DEBUG [RS:2;jenkins-hbase4:44933] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-10-01 19:01:26,184 DEBUG [RS:2;jenkins-hbase4:44933] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:01:26,184 DEBUG [RS:2;jenkins-hbase4:44933] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44933,1696186884649' 2023-10-01 19:01:26,184 DEBUG [RS:2;jenkins-hbase4:44933] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 19:01:26,184 DEBUG [RS:2;jenkins-hbase4:44933] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 19:01:26,185 DEBUG [RS:2;jenkins-hbase4:44933] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-10-01 19:01:26,185 INFO [RS:2;jenkins-hbase4:44933] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-10-01 19:01:26,185 INFO [RS:2;jenkins-hbase4:44933] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-10-01 19:01:26,197 DEBUG [jenkins-hbase4:42819] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-10-01 19:01:26,202 DEBUG [jenkins-hbase4:42819] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-01 19:01:26,208 DEBUG [jenkins-hbase4:42819] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-01 19:01:26,208 DEBUG [jenkins-hbase4:42819] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-01 19:01:26,208 DEBUG [jenkins-hbase4:42819] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-01 19:01:26,208 DEBUG [jenkins-hbase4:42819] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-01 19:01:26,211 INFO [PEWorker-2] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,44933,1696186884649, state=OPENING 2023-10-01 19:01:26,219 DEBUG [PEWorker-2] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-10-01 19:01:26,221 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-01 19:01:26,222 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-10-01 19:01:26,226 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,44933,1696186884649}] 2023-10-01 19:01:26,289 INFO [RS:0;jenkins-hbase4:46609] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46609%2C1696186884566, suffix=, logDir=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/WALs/jenkins-hbase4.apache.org,46609,1696186884566, archiveDir=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/oldWALs, maxLogs=32 2023-10-01 19:01:26,289 INFO [RS:1;jenkins-hbase4:36507] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36507%2C1696186884612, suffix=, logDir=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/WALs/jenkins-hbase4.apache.org,36507,1696186884612, archiveDir=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/oldWALs, maxLogs=32 2023-10-01 19:01:26,289 INFO [RS:2;jenkins-hbase4:44933] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44933%2C1696186884649, suffix=, logDir=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/WALs/jenkins-hbase4.apache.org,44933,1696186884649, archiveDir=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/oldWALs, maxLogs=32 2023-10-01 19:01:26,313 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38837,DS-d3a3653d-8bbd-4e54-b7ce-b178110bbe4f,DISK] 2023-10-01 19:01:26,313 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33829,DS-1e3a6ce5-bdd9-4556-a298-97c185756a91,DISK] 2023-10-01 19:01:26,313 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42365,DS-45d56a32-d59e-4b22-a3b5-c3e164f8825e,DISK] 2023-10-01 19:01:26,331 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42365,DS-45d56a32-d59e-4b22-a3b5-c3e164f8825e,DISK] 2023-10-01 19:01:26,331 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38837,DS-d3a3653d-8bbd-4e54-b7ce-b178110bbe4f,DISK] 2023-10-01 19:01:26,331 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33829,DS-1e3a6ce5-bdd9-4556-a298-97c185756a91,DISK] 2023-10-01 19:01:26,335 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38837,DS-d3a3653d-8bbd-4e54-b7ce-b178110bbe4f,DISK] 2023-10-01 19:01:26,335 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42365,DS-45d56a32-d59e-4b22-a3b5-c3e164f8825e,DISK] 2023-10-01 19:01:26,338 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33829,DS-1e3a6ce5-bdd9-4556-a298-97c185756a91,DISK] 2023-10-01 19:01:26,339 INFO [RS:2;jenkins-hbase4:44933] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/WALs/jenkins-hbase4.apache.org,44933,1696186884649/jenkins-hbase4.apache.org%2C44933%2C1696186884649.1696186886293 2023-10-01 19:01:26,346 DEBUG [RS:2;jenkins-hbase4:44933] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38837,DS-d3a3653d-8bbd-4e54-b7ce-b178110bbe4f,DISK], DatanodeInfoWithStorage[127.0.0.1:42365,DS-45d56a32-d59e-4b22-a3b5-c3e164f8825e,DISK], DatanodeInfoWithStorage[127.0.0.1:33829,DS-1e3a6ce5-bdd9-4556-a298-97c185756a91,DISK]] 2023-10-01 19:01:26,355 INFO [RS:1;jenkins-hbase4:36507] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/WALs/jenkins-hbase4.apache.org,36507,1696186884612/jenkins-hbase4.apache.org%2C36507%2C1696186884612.1696186886293 2023-10-01 19:01:26,356 INFO [RS:0;jenkins-hbase4:46609] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/WALs/jenkins-hbase4.apache.org,46609,1696186884566/jenkins-hbase4.apache.org%2C46609%2C1696186884566.1696186886293 2023-10-01 19:01:26,356 DEBUG [RS:1;jenkins-hbase4:36507] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42365,DS-45d56a32-d59e-4b22-a3b5-c3e164f8825e,DISK], DatanodeInfoWithStorage[127.0.0.1:38837,DS-d3a3653d-8bbd-4e54-b7ce-b178110bbe4f,DISK], DatanodeInfoWithStorage[127.0.0.1:33829,DS-1e3a6ce5-bdd9-4556-a298-97c185756a91,DISK]] 2023-10-01 19:01:26,357 DEBUG [RS:0;jenkins-hbase4:46609] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38837,DS-d3a3653d-8bbd-4e54-b7ce-b178110bbe4f,DISK], DatanodeInfoWithStorage[127.0.0.1:42365,DS-45d56a32-d59e-4b22-a3b5-c3e164f8825e,DISK], DatanodeInfoWithStorage[127.0.0.1:33829,DS-1e3a6ce5-bdd9-4556-a298-97c185756a91,DISK]] 2023-10-01 19:01:26,412 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:01:26,414 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-01 19:01:26,417 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37074, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-01 19:01:26,429 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-10-01 19:01:26,429 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-01 19:01:26,433 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44933%2C1696186884649.meta, suffix=.meta, logDir=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/WALs/jenkins-hbase4.apache.org,44933,1696186884649, archiveDir=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/oldWALs, maxLogs=32 2023-10-01 19:01:26,453 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42365,DS-45d56a32-d59e-4b22-a3b5-c3e164f8825e,DISK] 2023-10-01 19:01:26,453 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33829,DS-1e3a6ce5-bdd9-4556-a298-97c185756a91,DISK] 2023-10-01 19:01:26,455 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38837,DS-d3a3653d-8bbd-4e54-b7ce-b178110bbe4f,DISK] 2023-10-01 19:01:26,463 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/WALs/jenkins-hbase4.apache.org,44933,1696186884649/jenkins-hbase4.apache.org%2C44933%2C1696186884649.meta.1696186886434.meta 2023-10-01 19:01:26,463 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42365,DS-45d56a32-d59e-4b22-a3b5-c3e164f8825e,DISK], DatanodeInfoWithStorage[127.0.0.1:33829,DS-1e3a6ce5-bdd9-4556-a298-97c185756a91,DISK], DatanodeInfoWithStorage[127.0.0.1:38837,DS-d3a3653d-8bbd-4e54-b7ce-b178110bbe4f,DISK]] 2023-10-01 19:01:26,464 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-10-01 19:01:26,465 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-10-01 19:01:26,466 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 19:01:26,467 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-10-01 19:01:26,469 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-10-01 19:01:26,471 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-10-01 19:01:26,516 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-10-01 19:01:26,517 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 19:01:26,517 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-10-01 19:01:26,517 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-10-01 19:01:26,520 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-10-01 19:01:26,522 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/hbase/meta/1588230740/info 2023-10-01 19:01:26,522 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/hbase/meta/1588230740/info 2023-10-01 19:01:26,523 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-10-01 19:01:26,524 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 19:01:26,524 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-10-01 19:01:26,526 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/hbase/meta/1588230740/rep_barrier 2023-10-01 19:01:26,526 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/hbase/meta/1588230740/rep_barrier 2023-10-01 19:01:26,527 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-10-01 19:01:26,528 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 19:01:26,528 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-10-01 19:01:26,530 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/hbase/meta/1588230740/table 2023-10-01 19:01:26,530 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/hbase/meta/1588230740/table 2023-10-01 19:01:26,530 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-10-01 19:01:26,531 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 19:01:26,533 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/hbase/meta/1588230740 2023-10-01 19:01:26,536 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/hbase/meta/1588230740 2023-10-01 19:01:26,539 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-10-01 19:01:26,542 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-10-01 19:01:26,543 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63417174, jitterRate=-0.055010467767715454}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-10-01 19:01:26,546 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-10-01 19:01:26,557 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1696186886403 2023-10-01 19:01:26,574 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-10-01 19:01:26,575 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-10-01 19:01:26,576 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,44933,1696186884649, state=OPEN 2023-10-01 19:01:26,579 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-10-01 19:01:26,580 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-10-01 19:01:26,585 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=3, resume processing ppid=2 2023-10-01 19:01:26,585 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,44933,1696186884649 in 354 msec 2023-10-01 19:01:26,590 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=2, resume processing ppid=1 2023-10-01 19:01:26,591 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 570 msec 2023-10-01 19:01:26,595 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 835 msec 2023-10-01 19:01:26,596 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1696186886596, completionTime=-1 2023-10-01 19:01:26,596 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-10-01 19:01:26,596 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-10-01 19:01:26,661 DEBUG [hconnection-0x618534e4-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 19:01:26,663 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37088, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 19:01:26,690 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-10-01 19:01:26,690 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1696186946690 2023-10-01 19:01:26,690 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1696187006690 2023-10-01 19:01:26,690 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 94 msec 2023-10-01 19:01:26,719 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42819,1696186883324-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-01 19:01:26,720 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42819,1696186883324-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-10-01 19:01:26,720 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42819,1696186883324-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-10-01 19:01:26,722 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:42819, period=300000, unit=MILLISECONDS is enabled. 2023-10-01 19:01:26,722 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-10-01 19:01:26,729 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-10-01 19:01:26,741 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-10-01 19:01:26,743 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-10-01 19:01:26,756 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-10-01 19:01:26,759 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-10-01 19:01:26,761 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-01 19:01:26,783 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/hbase/namespace/1f6221aa17f01950b2b625187d3b00f5 2023-10-01 19:01:26,787 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/hbase/namespace/1f6221aa17f01950b2b625187d3b00f5 empty. 2023-10-01 19:01:26,788 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/hbase/namespace/1f6221aa17f01950b2b625187d3b00f5 2023-10-01 19:01:26,788 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-10-01 19:01:26,825 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-10-01 19:01:26,827 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 1f6221aa17f01950b2b625187d3b00f5, NAME => 'hbase:namespace,,1696186886742.1f6221aa17f01950b2b625187d3b00f5.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp 2023-10-01 19:01:26,848 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1696186886742.1f6221aa17f01950b2b625187d3b00f5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 19:01:26,848 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 1f6221aa17f01950b2b625187d3b00f5, disabling compactions & flushes 2023-10-01 19:01:26,848 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1696186886742.1f6221aa17f01950b2b625187d3b00f5. 2023-10-01 19:01:26,848 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1696186886742.1f6221aa17f01950b2b625187d3b00f5. 2023-10-01 19:01:26,848 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1696186886742.1f6221aa17f01950b2b625187d3b00f5. after waiting 0 ms 2023-10-01 19:01:26,848 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1696186886742.1f6221aa17f01950b2b625187d3b00f5. 2023-10-01 19:01:26,848 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1696186886742.1f6221aa17f01950b2b625187d3b00f5. 2023-10-01 19:01:26,848 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 1f6221aa17f01950b2b625187d3b00f5: 2023-10-01 19:01:26,853 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-10-01 19:01:26,867 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1696186886742.1f6221aa17f01950b2b625187d3b00f5.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1696186886856"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696186886856"}]},"ts":"1696186886856"} 2023-10-01 19:01:26,895 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-01 19:01:26,897 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-01 19:01:26,901 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696186886897"}]},"ts":"1696186886897"} 2023-10-01 19:01:26,905 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-10-01 19:01:26,911 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-01 19:01:26,912 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-01 19:01:26,912 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-01 19:01:26,912 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-01 19:01:26,912 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-01 19:01:26,915 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=1f6221aa17f01950b2b625187d3b00f5, ASSIGN}] 2023-10-01 19:01:26,917 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=1f6221aa17f01950b2b625187d3b00f5, ASSIGN 2023-10-01 19:01:26,919 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=1f6221aa17f01950b2b625187d3b00f5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44933,1696186884649; forceNewPlan=false, retain=false 2023-10-01 19:01:27,072 INFO [jenkins-hbase4:42819] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-10-01 19:01:27,074 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=1f6221aa17f01950b2b625187d3b00f5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:01:27,074 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1696186886742.1f6221aa17f01950b2b625187d3b00f5.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1696186887073"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696186887073"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696186887073"}]},"ts":"1696186887073"} 2023-10-01 19:01:27,080 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 1f6221aa17f01950b2b625187d3b00f5, server=jenkins-hbase4.apache.org,44933,1696186884649}] 2023-10-01 19:01:27,242 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1696186886742.1f6221aa17f01950b2b625187d3b00f5. 2023-10-01 19:01:27,243 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1f6221aa17f01950b2b625187d3b00f5, NAME => 'hbase:namespace,,1696186886742.1f6221aa17f01950b2b625187d3b00f5.', STARTKEY => '', ENDKEY => ''} 2023-10-01 19:01:27,243 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1696186886742.1f6221aa17f01950b2b625187d3b00f5. service=AccessControlService 2023-10-01 19:01:27,244 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 19:01:27,244 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 1f6221aa17f01950b2b625187d3b00f5 2023-10-01 19:01:27,244 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1696186886742.1f6221aa17f01950b2b625187d3b00f5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 19:01:27,244 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1f6221aa17f01950b2b625187d3b00f5 2023-10-01 19:01:27,245 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1f6221aa17f01950b2b625187d3b00f5 2023-10-01 19:01:27,247 INFO [StoreOpener-1f6221aa17f01950b2b625187d3b00f5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1f6221aa17f01950b2b625187d3b00f5 2023-10-01 19:01:27,249 DEBUG [StoreOpener-1f6221aa17f01950b2b625187d3b00f5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/hbase/namespace/1f6221aa17f01950b2b625187d3b00f5/info 2023-10-01 19:01:27,249 DEBUG [StoreOpener-1f6221aa17f01950b2b625187d3b00f5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/hbase/namespace/1f6221aa17f01950b2b625187d3b00f5/info 2023-10-01 19:01:27,250 INFO [StoreOpener-1f6221aa17f01950b2b625187d3b00f5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1f6221aa17f01950b2b625187d3b00f5 columnFamilyName info 2023-10-01 19:01:27,250 INFO [StoreOpener-1f6221aa17f01950b2b625187d3b00f5-1] regionserver.HStore(310): Store=1f6221aa17f01950b2b625187d3b00f5/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 19:01:27,252 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/hbase/namespace/1f6221aa17f01950b2b625187d3b00f5 2023-10-01 19:01:27,253 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/hbase/namespace/1f6221aa17f01950b2b625187d3b00f5 2023-10-01 19:01:27,257 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1f6221aa17f01950b2b625187d3b00f5 2023-10-01 19:01:27,261 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/hbase/namespace/1f6221aa17f01950b2b625187d3b00f5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-01 19:01:27,261 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1f6221aa17f01950b2b625187d3b00f5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73550252, jitterRate=0.09598416090011597}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-01 19:01:27,261 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1f6221aa17f01950b2b625187d3b00f5: 2023-10-01 19:01:27,264 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1696186886742.1f6221aa17f01950b2b625187d3b00f5., pid=6, masterSystemTime=1696186887234 2023-10-01 19:01:27,267 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1696186886742.1f6221aa17f01950b2b625187d3b00f5. 2023-10-01 19:01:27,267 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1696186886742.1f6221aa17f01950b2b625187d3b00f5. 2023-10-01 19:01:27,269 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=1f6221aa17f01950b2b625187d3b00f5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:01:27,269 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1696186886742.1f6221aa17f01950b2b625187d3b00f5.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1696186887268"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696186887268"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696186887268"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696186887268"}]},"ts":"1696186887268"} 2023-10-01 19:01:27,276 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=6, resume processing ppid=5 2023-10-01 19:01:27,276 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 1f6221aa17f01950b2b625187d3b00f5, server=jenkins-hbase4.apache.org,44933,1696186884649 in 192 msec 2023-10-01 19:01:27,280 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=5, resume processing ppid=4 2023-10-01 19:01:27,281 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=1f6221aa17f01950b2b625187d3b00f5, ASSIGN in 362 msec 2023-10-01 19:01:27,282 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-01 19:01:27,282 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696186887282"}]},"ts":"1696186887282"} 2023-10-01 19:01:27,285 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-10-01 19:01:27,288 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-10-01 19:01:27,291 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 544 msec 2023-10-01 19:01:27,359 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-10-01 19:01:27,360 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-10-01 19:01:27,360 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-01 19:01:27,392 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-10-01 19:01:27,408 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-10-01 19:01:27,414 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 27 msec 2023-10-01 19:01:27,425 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-10-01 19:01:27,436 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-10-01 19:01:27,441 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 15 msec 2023-10-01 19:01:27,456 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-10-01 19:01:27,458 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-10-01 19:01:27,458 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.744sec 2023-10-01 19:01:27,461 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-10-01 19:01:27,463 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-10-01 19:01:27,463 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-10-01 19:01:27,464 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42819,1696186883324-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-10-01 19:01:27,464 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42819,1696186883324-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-10-01 19:01:27,485 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-10-01 19:01:27,487 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-10-01 19:01:27,488 DEBUG [Listener at localhost/37115] zookeeper.ReadOnlyZKClient(139): Connect 0x7b3bae5a to 127.0.0.1:55462 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 19:01:27,489 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-10-01 19:01:27,492 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-01 19:01:27,495 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-10-01 19:01:27,495 DEBUG [Listener at localhost/37115] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2cba94b4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 19:01:27,495 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/hbase/acl/6be1c70a77aee64b46a6559a8da20c52 2023-10-01 19:01:27,496 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/hbase/acl/6be1c70a77aee64b46a6559a8da20c52 empty. 2023-10-01 19:01:27,501 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/hbase/acl/6be1c70a77aee64b46a6559a8da20c52 2023-10-01 19:01:27,501 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-10-01 19:01:27,510 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-01 19:01:27,519 DEBUG [hconnection-0x6846c5bc-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 19:01:27,536 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37102, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 19:01:27,536 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-10-01 19:01:27,539 INFO [Listener at localhost/37115] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,42819,1696186883324 2023-10-01 19:01:27,539 INFO [Listener at localhost/37115] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-10-01 19:01:27,540 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 6be1c70a77aee64b46a6559a8da20c52, NAME => 'hbase:acl,,1696186887481.6be1c70a77aee64b46a6559a8da20c52.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp 2023-10-01 19:01:27,540 INFO [Listener at localhost/37115] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba/test.cache.data in system properties and HBase conf 2023-10-01 19:01:27,540 INFO [Listener at localhost/37115] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba/hadoop.tmp.dir in system properties and HBase conf 2023-10-01 19:01:27,540 INFO [Listener at localhost/37115] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba/hadoop.log.dir in system properties and HBase conf 2023-10-01 19:01:27,540 INFO [Listener at localhost/37115] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba/mapreduce.cluster.local.dir in system properties and HBase conf 2023-10-01 19:01:27,540 INFO [Listener at localhost/37115] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-10-01 19:01:27,540 INFO [Listener at localhost/37115] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-10-01 19:01:27,541 INFO [Listener at localhost/37115] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-10-01 19:01:27,541 INFO [Listener at localhost/37115] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-10-01 19:01:27,541 INFO [Listener at localhost/37115] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-10-01 19:01:27,541 INFO [Listener at localhost/37115] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-01 19:01:27,541 INFO [Listener at localhost/37115] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-10-01 19:01:27,541 INFO [Listener at localhost/37115] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-10-01 19:01:27,542 INFO [Listener at localhost/37115] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-01 19:01:27,542 INFO [Listener at localhost/37115] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-01 19:01:27,542 INFO [Listener at localhost/37115] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-10-01 19:01:27,542 INFO [Listener at localhost/37115] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba/nfs.dump.dir in system properties and HBase conf 2023-10-01 19:01:27,542 INFO [Listener at localhost/37115] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba/java.io.tmpdir in system properties and HBase conf 2023-10-01 19:01:27,542 INFO [Listener at localhost/37115] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-01 19:01:27,542 INFO [Listener at localhost/37115] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-10-01 19:01:27,543 INFO [Listener at localhost/37115] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-10-01 19:01:27,562 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1696186887481.6be1c70a77aee64b46a6559a8da20c52.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 19:01:27,562 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 6be1c70a77aee64b46a6559a8da20c52, disabling compactions & flushes 2023-10-01 19:01:27,562 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1696186887481.6be1c70a77aee64b46a6559a8da20c52. 2023-10-01 19:01:27,563 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1696186887481.6be1c70a77aee64b46a6559a8da20c52. 2023-10-01 19:01:27,563 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1696186887481.6be1c70a77aee64b46a6559a8da20c52. after waiting 0 ms 2023-10-01 19:01:27,563 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1696186887481.6be1c70a77aee64b46a6559a8da20c52. 2023-10-01 19:01:27,563 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1696186887481.6be1c70a77aee64b46a6559a8da20c52. 2023-10-01 19:01:27,563 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 6be1c70a77aee64b46a6559a8da20c52: 2023-10-01 19:01:27,567 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-10-01 19:01:27,569 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1696186887481.6be1c70a77aee64b46a6559a8da20c52.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1696186887569"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696186887569"}]},"ts":"1696186887569"} 2023-10-01 19:01:27,571 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-01 19:01:27,573 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-01 19:01:27,573 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696186887573"}]},"ts":"1696186887573"} 2023-10-01 19:01:27,575 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-10-01 19:01:27,579 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-01 19:01:27,581 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-01 19:01:27,581 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-01 19:01:27,581 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-01 19:01:27,581 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-01 19:01:27,581 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=6be1c70a77aee64b46a6559a8da20c52, ASSIGN}] 2023-10-01 19:01:27,583 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=6be1c70a77aee64b46a6559a8da20c52, ASSIGN 2023-10-01 19:01:27,585 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=6be1c70a77aee64b46a6559a8da20c52, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36507,1696186884612; forceNewPlan=false, retain=false 2023-10-01 19:01:27,616 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-01 19:01:27,735 INFO [jenkins-hbase4:42819] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-10-01 19:01:27,736 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=6be1c70a77aee64b46a6559a8da20c52, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:01:27,736 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1696186887481.6be1c70a77aee64b46a6559a8da20c52.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1696186887736"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696186887736"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696186887736"}]},"ts":"1696186887736"} 2023-10-01 19:01:27,740 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 6be1c70a77aee64b46a6559a8da20c52, server=jenkins-hbase4.apache.org,36507,1696186884612}] 2023-10-01 19:01:27,816 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-01 19:01:27,895 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:01:27,896 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-01 19:01:27,900 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40532, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-01 19:01:27,906 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1696186887481.6be1c70a77aee64b46a6559a8da20c52. 2023-10-01 19:01:27,906 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6be1c70a77aee64b46a6559a8da20c52, NAME => 'hbase:acl,,1696186887481.6be1c70a77aee64b46a6559a8da20c52.', STARTKEY => '', ENDKEY => ''} 2023-10-01 19:01:27,907 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1696186887481.6be1c70a77aee64b46a6559a8da20c52. service=AccessControlService 2023-10-01 19:01:27,907 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 19:01:27,907 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 6be1c70a77aee64b46a6559a8da20c52 2023-10-01 19:01:27,907 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1696186887481.6be1c70a77aee64b46a6559a8da20c52.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 19:01:27,907 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6be1c70a77aee64b46a6559a8da20c52 2023-10-01 19:01:27,907 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6be1c70a77aee64b46a6559a8da20c52 2023-10-01 19:01:27,909 INFO [StoreOpener-6be1c70a77aee64b46a6559a8da20c52-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 6be1c70a77aee64b46a6559a8da20c52 2023-10-01 19:01:27,911 DEBUG [StoreOpener-6be1c70a77aee64b46a6559a8da20c52-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/hbase/acl/6be1c70a77aee64b46a6559a8da20c52/l 2023-10-01 19:01:27,911 DEBUG [StoreOpener-6be1c70a77aee64b46a6559a8da20c52-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/hbase/acl/6be1c70a77aee64b46a6559a8da20c52/l 2023-10-01 19:01:27,912 INFO [StoreOpener-6be1c70a77aee64b46a6559a8da20c52-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6be1c70a77aee64b46a6559a8da20c52 columnFamilyName l 2023-10-01 19:01:27,913 INFO [StoreOpener-6be1c70a77aee64b46a6559a8da20c52-1] regionserver.HStore(310): Store=6be1c70a77aee64b46a6559a8da20c52/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 19:01:27,914 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/hbase/acl/6be1c70a77aee64b46a6559a8da20c52 2023-10-01 19:01:27,916 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/hbase/acl/6be1c70a77aee64b46a6559a8da20c52 2023-10-01 19:01:27,920 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6be1c70a77aee64b46a6559a8da20c52 2023-10-01 19:01:27,925 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/hbase/acl/6be1c70a77aee64b46a6559a8da20c52/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-01 19:01:27,926 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6be1c70a77aee64b46a6559a8da20c52; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65964374, jitterRate=-0.017054229974746704}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-01 19:01:27,926 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6be1c70a77aee64b46a6559a8da20c52: 2023-10-01 19:01:27,928 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1696186887481.6be1c70a77aee64b46a6559a8da20c52., pid=11, masterSystemTime=1696186887895 2023-10-01 19:01:27,932 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1696186887481.6be1c70a77aee64b46a6559a8da20c52. 2023-10-01 19:01:27,933 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1696186887481.6be1c70a77aee64b46a6559a8da20c52. 2023-10-01 19:01:27,934 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=6be1c70a77aee64b46a6559a8da20c52, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:01:27,934 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1696186887481.6be1c70a77aee64b46a6559a8da20c52.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1696186887934"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696186887934"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696186887934"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696186887934"}]},"ts":"1696186887934"} 2023-10-01 19:01:27,941 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=11, resume processing ppid=10 2023-10-01 19:01:27,941 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 6be1c70a77aee64b46a6559a8da20c52, server=jenkins-hbase4.apache.org,36507,1696186884612 in 197 msec 2023-10-01 19:01:27,945 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=10, resume processing ppid=9 2023-10-01 19:01:27,945 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=6be1c70a77aee64b46a6559a8da20c52, ASSIGN in 360 msec 2023-10-01 19:01:27,946 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-01 19:01:27,947 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696186887947"}]},"ts":"1696186887947"} 2023-10-01 19:01:27,949 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-10-01 19:01:27,953 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-10-01 19:01:27,956 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 468 msec 2023-10-01 19:01:28,117 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-01 19:01:28,117 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-10-01 19:01:28,128 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-10-01 19:01:28,692 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-01 19:01:29,054 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-10-01 19:01:29,061 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_37263_jobhistory____kuh8c4/webapp 2023-10-01 19:01:29,255 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-10-01 19:01:29,255 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-10-01 19:01:29,256 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-10-01 19:01:29,259 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-10-01 19:01:29,347 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-01 19:01:29,707 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-01 19:01:30,070 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-10-01 19:01:30,102 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:37263 2023-10-01 19:01:30,185 WARN [Listener at jenkins-hbase4.apache.org/34955] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-01 19:01:30,422 WARN [Listener at jenkins-hbase4.apache.org/34955] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-10-01 19:01:30,423 INFO [Listener at jenkins-hbase4.apache.org/34955] log.Slf4jLog(67): jetty-6.1.26 2023-10-01 19:01:30,430 INFO [Listener at jenkins-hbase4.apache.org/34955] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_34131_cluster____.gsr90q/webapp 2023-10-01 19:01:30,500 INFO [Listener at jenkins-hbase4.apache.org/34955] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-10-01 19:01:30,500 INFO [Listener at jenkins-hbase4.apache.org/34955] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-10-01 19:01:30,500 INFO [Listener at jenkins-hbase4.apache.org/34955] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-10-01 19:01:30,501 INFO [Listener at jenkins-hbase4.apache.org/34955] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-10-01 19:01:30,511 INFO [Listener at jenkins-hbase4.apache.org/34955] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-01 19:01:30,698 INFO [Listener at jenkins-hbase4.apache.org/34955] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-01 19:01:30,779 INFO [Listener at jenkins-hbase4.apache.org/34955] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-01 19:01:30,792 INFO [Listener at jenkins-hbase4.apache.org/34955] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:34131 2023-10-01 19:01:31,313 WARN [Listener at jenkins-hbase4.apache.org/35441] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-01 19:01:31,339 WARN [Listener at jenkins-hbase4.apache.org/35441] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-10-01 19:01:31,339 INFO [Listener at jenkins-hbase4.apache.org/35441] log.Slf4jLog(67): jetty-6.1.26 2023-10-01 19:01:31,348 INFO [Listener at jenkins-hbase4.apache.org/35441] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_43725_node____.qm31ev/webapp 2023-10-01 19:01:31,409 INFO [Listener at jenkins-hbase4.apache.org/35441] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-10-01 19:01:31,409 INFO [Listener at jenkins-hbase4.apache.org/35441] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-10-01 19:01:31,409 INFO [Listener at jenkins-hbase4.apache.org/35441] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-10-01 19:01:31,409 INFO [Listener at jenkins-hbase4.apache.org/35441] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-10-01 19:01:31,420 INFO [Listener at jenkins-hbase4.apache.org/35441] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-01 19:01:31,442 INFO [Listener at jenkins-hbase4.apache.org/35441] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-01 19:01:31,519 INFO [Listener at jenkins-hbase4.apache.org/35441] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-01 19:01:31,549 INFO [Listener at jenkins-hbase4.apache.org/35441] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:43725 2023-10-01 19:01:31,717 WARN [Listener at jenkins-hbase4.apache.org/36885] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-01 19:01:31,723 WARN [Listener at jenkins-hbase4.apache.org/36885] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-10-01 19:01:31,723 INFO [Listener at jenkins-hbase4.apache.org/36885] log.Slf4jLog(67): jetty-6.1.26 2023-10-01 19:01:31,730 INFO [Listener at jenkins-hbase4.apache.org/36885] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_35177_node____dr4h9p/webapp 2023-10-01 19:01:31,780 INFO [Listener at jenkins-hbase4.apache.org/36885] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-10-01 19:01:31,781 INFO [Listener at jenkins-hbase4.apache.org/36885] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-10-01 19:01:31,781 INFO [Listener at jenkins-hbase4.apache.org/36885] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-10-01 19:01:31,781 INFO [Listener at jenkins-hbase4.apache.org/36885] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-10-01 19:01:31,793 INFO [Listener at jenkins-hbase4.apache.org/36885] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-01 19:01:31,811 INFO [Listener at jenkins-hbase4.apache.org/36885] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-01 19:01:31,865 INFO [Listener at jenkins-hbase4.apache.org/36885] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-01 19:01:31,870 INFO [Listener at jenkins-hbase4.apache.org/36885] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:35177 2023-10-01 19:01:31,898 INFO [Listener at jenkins-hbase4.apache.org/36885] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-10-01 19:01:31,900 INFO [Listener at jenkins-hbase4.apache.org/36885] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-10-01 19:01:31,958 INFO [Listener at jenkins-hbase4.apache.org/36885] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=703, OpenFileDescriptor=898, MaxFileDescriptor=60000, SystemLoadAverage=134, ProcessCount=164, AvailableMemoryMB=2382 2023-10-01 19:01:31,958 WARN [Listener at jenkins-hbase4.apache.org/36885] hbase.ResourceChecker(130): Thread=703 is superior to 500 2023-10-01 19:01:31,977 DEBUG [Listener at jenkins-hbase4.apache.org/36885] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-01 19:01:31,983 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39134, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-01 19:01:31,990 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-01 19:01:31,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] procedure2.ProcedureExecutor(1028): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-10-01 19:01:31,995 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-10-01 19:01:31,996 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-10-01 19:01:31,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-01 19:01:32,001 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-01 19:01:32,005 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportWithTargetName/8d421dbf10e8d3a55ee096b22ebe703f 2023-10-01 19:01:32,005 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportWithTargetName/6d8f208fed3946037503c43f340790cf 2023-10-01 19:01:32,006 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportWithTargetName/6d8f208fed3946037503c43f340790cf empty. 2023-10-01 19:01:32,006 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportWithTargetName/8d421dbf10e8d3a55ee096b22ebe703f empty. 2023-10-01 19:01:32,008 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportWithTargetName/6d8f208fed3946037503c43f340790cf 2023-10-01 19:01:32,010 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportWithTargetName/8d421dbf10e8d3a55ee096b22ebe703f 2023-10-01 19:01:32,010 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-10-01 19:01:32,043 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-10-01 19:01:32,045 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 8d421dbf10e8d3a55ee096b22ebe703f, NAME => 'testtb-testExportWithTargetName,,1696186891990.8d421dbf10e8d3a55ee096b22ebe703f.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp 2023-10-01 19:01:32,045 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 6d8f208fed3946037503c43f340790cf, NAME => 'testtb-testExportWithTargetName,1,1696186891990.6d8f208fed3946037503c43f340790cf.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp 2023-10-01 19:01:32,074 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-01 19:01:32,087 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1696186891990.6d8f208fed3946037503c43f340790cf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 19:01:32,088 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 6d8f208fed3946037503c43f340790cf, disabling compactions & flushes 2023-10-01 19:01:32,088 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1696186891990.6d8f208fed3946037503c43f340790cf. 2023-10-01 19:01:32,088 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1696186891990.6d8f208fed3946037503c43f340790cf. 2023-10-01 19:01:32,088 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1696186891990.6d8f208fed3946037503c43f340790cf. after waiting 0 ms 2023-10-01 19:01:32,088 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1696186891990.6d8f208fed3946037503c43f340790cf. 2023-10-01 19:01:32,088 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1696186891990.6d8f208fed3946037503c43f340790cf. 2023-10-01 19:01:32,088 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 6d8f208fed3946037503c43f340790cf: 2023-10-01 19:01:32,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-01 19:01:32,255 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-10-01 19:01:32,257 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-10-01 19:01:32,258 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-10-01 19:01:32,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-01 19:01:32,485 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1696186891990.8d421dbf10e8d3a55ee096b22ebe703f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 19:01:32,485 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 8d421dbf10e8d3a55ee096b22ebe703f, disabling compactions & flushes 2023-10-01 19:01:32,485 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1696186891990.8d421dbf10e8d3a55ee096b22ebe703f. 2023-10-01 19:01:32,485 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1696186891990.8d421dbf10e8d3a55ee096b22ebe703f. 2023-10-01 19:01:32,485 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1696186891990.8d421dbf10e8d3a55ee096b22ebe703f. after waiting 0 ms 2023-10-01 19:01:32,485 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1696186891990.8d421dbf10e8d3a55ee096b22ebe703f. 2023-10-01 19:01:32,485 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1696186891990.8d421dbf10e8d3a55ee096b22ebe703f. 2023-10-01 19:01:32,485 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 8d421dbf10e8d3a55ee096b22ebe703f: 2023-10-01 19:01:32,490 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-10-01 19:01:32,491 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1696186891990.6d8f208fed3946037503c43f340790cf.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696186892491"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696186892491"}]},"ts":"1696186892491"} 2023-10-01 19:01:32,491 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1696186891990.8d421dbf10e8d3a55ee096b22ebe703f.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696186892491"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696186892491"}]},"ts":"1696186892491"} 2023-10-01 19:01:32,541 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-01 19:01:32,542 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-01 19:01:32,543 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696186892542"}]},"ts":"1696186892542"} 2023-10-01 19:01:32,545 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-10-01 19:01:32,550 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-01 19:01:32,552 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-01 19:01:32,553 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-01 19:01:32,553 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-01 19:01:32,553 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-01 19:01:32,553 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=8d421dbf10e8d3a55ee096b22ebe703f, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=6d8f208fed3946037503c43f340790cf, ASSIGN}] 2023-10-01 19:01:32,556 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=6d8f208fed3946037503c43f340790cf, ASSIGN 2023-10-01 19:01:32,556 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=8d421dbf10e8d3a55ee096b22ebe703f, ASSIGN 2023-10-01 19:01:32,558 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=6d8f208fed3946037503c43f340790cf, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36507,1696186884612; forceNewPlan=false, retain=false 2023-10-01 19:01:32,558 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=8d421dbf10e8d3a55ee096b22ebe703f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44933,1696186884649; forceNewPlan=false, retain=false 2023-10-01 19:01:32,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-01 19:01:32,708 INFO [jenkins-hbase4:42819] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-01 19:01:32,711 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=8d421dbf10e8d3a55ee096b22ebe703f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:01:32,711 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=6d8f208fed3946037503c43f340790cf, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:01:32,711 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1696186891990.8d421dbf10e8d3a55ee096b22ebe703f.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696186892710"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696186892710"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696186892710"}]},"ts":"1696186892710"} 2023-10-01 19:01:32,711 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1696186891990.6d8f208fed3946037503c43f340790cf.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696186892711"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696186892711"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696186892711"}]},"ts":"1696186892711"} 2023-10-01 19:01:32,714 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=15, ppid=13, state=RUNNABLE; OpenRegionProcedure 8d421dbf10e8d3a55ee096b22ebe703f, server=jenkins-hbase4.apache.org,44933,1696186884649}] 2023-10-01 19:01:32,716 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=16, ppid=14, state=RUNNABLE; OpenRegionProcedure 6d8f208fed3946037503c43f340790cf, server=jenkins-hbase4.apache.org,36507,1696186884612}] 2023-10-01 19:01:32,872 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1696186891990.8d421dbf10e8d3a55ee096b22ebe703f. 2023-10-01 19:01:32,873 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8d421dbf10e8d3a55ee096b22ebe703f, NAME => 'testtb-testExportWithTargetName,,1696186891990.8d421dbf10e8d3a55ee096b22ebe703f.', STARTKEY => '', ENDKEY => '1'} 2023-10-01 19:01:32,873 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1696186891990.8d421dbf10e8d3a55ee096b22ebe703f. service=AccessControlService 2023-10-01 19:01:32,873 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 19:01:32,873 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 8d421dbf10e8d3a55ee096b22ebe703f 2023-10-01 19:01:32,873 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1696186891990.8d421dbf10e8d3a55ee096b22ebe703f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 19:01:32,873 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 8d421dbf10e8d3a55ee096b22ebe703f 2023-10-01 19:01:32,873 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 8d421dbf10e8d3a55ee096b22ebe703f 2023-10-01 19:01:32,877 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1696186891990.6d8f208fed3946037503c43f340790cf. 2023-10-01 19:01:32,877 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6d8f208fed3946037503c43f340790cf, NAME => 'testtb-testExportWithTargetName,1,1696186891990.6d8f208fed3946037503c43f340790cf.', STARTKEY => '1', ENDKEY => ''} 2023-10-01 19:01:32,877 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1696186891990.6d8f208fed3946037503c43f340790cf. service=AccessControlService 2023-10-01 19:01:32,878 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 19:01:32,878 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 6d8f208fed3946037503c43f340790cf 2023-10-01 19:01:32,878 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1696186891990.6d8f208fed3946037503c43f340790cf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 19:01:32,878 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6d8f208fed3946037503c43f340790cf 2023-10-01 19:01:32,878 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6d8f208fed3946037503c43f340790cf 2023-10-01 19:01:32,879 INFO [StoreOpener-8d421dbf10e8d3a55ee096b22ebe703f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 8d421dbf10e8d3a55ee096b22ebe703f 2023-10-01 19:01:32,882 INFO [StoreOpener-6d8f208fed3946037503c43f340790cf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 6d8f208fed3946037503c43f340790cf 2023-10-01 19:01:32,882 DEBUG [StoreOpener-8d421dbf10e8d3a55ee096b22ebe703f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportWithTargetName/8d421dbf10e8d3a55ee096b22ebe703f/cf 2023-10-01 19:01:32,883 DEBUG [StoreOpener-8d421dbf10e8d3a55ee096b22ebe703f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportWithTargetName/8d421dbf10e8d3a55ee096b22ebe703f/cf 2023-10-01 19:01:32,884 DEBUG [StoreOpener-6d8f208fed3946037503c43f340790cf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportWithTargetName/6d8f208fed3946037503c43f340790cf/cf 2023-10-01 19:01:32,884 DEBUG [StoreOpener-6d8f208fed3946037503c43f340790cf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportWithTargetName/6d8f208fed3946037503c43f340790cf/cf 2023-10-01 19:01:32,887 INFO [StoreOpener-6d8f208fed3946037503c43f340790cf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6d8f208fed3946037503c43f340790cf columnFamilyName cf 2023-10-01 19:01:32,887 INFO [StoreOpener-8d421dbf10e8d3a55ee096b22ebe703f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8d421dbf10e8d3a55ee096b22ebe703f columnFamilyName cf 2023-10-01 19:01:32,890 INFO [StoreOpener-8d421dbf10e8d3a55ee096b22ebe703f-1] regionserver.HStore(310): Store=8d421dbf10e8d3a55ee096b22ebe703f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 19:01:32,890 INFO [StoreOpener-6d8f208fed3946037503c43f340790cf-1] regionserver.HStore(310): Store=6d8f208fed3946037503c43f340790cf/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 19:01:32,893 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportWithTargetName/8d421dbf10e8d3a55ee096b22ebe703f 2023-10-01 19:01:32,894 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportWithTargetName/6d8f208fed3946037503c43f340790cf 2023-10-01 19:01:32,894 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportWithTargetName/8d421dbf10e8d3a55ee096b22ebe703f 2023-10-01 19:01:32,894 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportWithTargetName/6d8f208fed3946037503c43f340790cf 2023-10-01 19:01:32,899 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 8d421dbf10e8d3a55ee096b22ebe703f 2023-10-01 19:01:32,899 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6d8f208fed3946037503c43f340790cf 2023-10-01 19:01:32,918 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportWithTargetName/8d421dbf10e8d3a55ee096b22ebe703f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-01 19:01:32,919 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportWithTargetName/6d8f208fed3946037503c43f340790cf/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-01 19:01:32,919 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 8d421dbf10e8d3a55ee096b22ebe703f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69633210, jitterRate=0.037615686655044556}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-01 19:01:32,919 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 8d421dbf10e8d3a55ee096b22ebe703f: 2023-10-01 19:01:32,919 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6d8f208fed3946037503c43f340790cf; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75470204, jitterRate=0.12459367513656616}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-01 19:01:32,920 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6d8f208fed3946037503c43f340790cf: 2023-10-01 19:01:32,921 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1696186891990.8d421dbf10e8d3a55ee096b22ebe703f., pid=15, masterSystemTime=1696186892866 2023-10-01 19:01:32,921 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1696186891990.6d8f208fed3946037503c43f340790cf., pid=16, masterSystemTime=1696186892868 2023-10-01 19:01:32,923 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1696186891990.8d421dbf10e8d3a55ee096b22ebe703f. 2023-10-01 19:01:32,923 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1696186891990.8d421dbf10e8d3a55ee096b22ebe703f. 2023-10-01 19:01:32,924 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=8d421dbf10e8d3a55ee096b22ebe703f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:01:32,924 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1696186891990.6d8f208fed3946037503c43f340790cf. 2023-10-01 19:01:32,924 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1696186891990.6d8f208fed3946037503c43f340790cf. 2023-10-01 19:01:32,924 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1696186891990.8d421dbf10e8d3a55ee096b22ebe703f.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696186892924"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696186892924"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696186892924"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696186892924"}]},"ts":"1696186892924"} 2023-10-01 19:01:32,925 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=6d8f208fed3946037503c43f340790cf, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:01:32,926 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1696186891990.6d8f208fed3946037503c43f340790cf.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696186892925"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696186892925"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696186892925"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696186892925"}]},"ts":"1696186892925"} 2023-10-01 19:01:32,931 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=15, resume processing ppid=13 2023-10-01 19:01:32,932 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=15, ppid=13, state=SUCCESS; OpenRegionProcedure 8d421dbf10e8d3a55ee096b22ebe703f, server=jenkins-hbase4.apache.org,44933,1696186884649 in 213 msec 2023-10-01 19:01:32,934 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=8d421dbf10e8d3a55ee096b22ebe703f, ASSIGN in 379 msec 2023-10-01 19:01:32,934 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=16, resume processing ppid=14 2023-10-01 19:01:32,935 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=16, ppid=14, state=SUCCESS; OpenRegionProcedure 6d8f208fed3946037503c43f340790cf, server=jenkins-hbase4.apache.org,36507,1696186884612 in 213 msec 2023-10-01 19:01:32,938 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=14, resume processing ppid=12 2023-10-01 19:01:32,938 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=6d8f208fed3946037503c43f340790cf, ASSIGN in 382 msec 2023-10-01 19:01:32,939 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-01 19:01:32,939 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696186892939"}]},"ts":"1696186892939"} 2023-10-01 19:01:32,941 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-10-01 19:01:32,945 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-10-01 19:01:32,950 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-10-01 19:01:32,956 DEBUG [PEWorker-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 19:01:32,959 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40536, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 19:01:32,963 DEBUG [hconnection-0x52e756e1-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 19:01:32,964 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37118, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=ClientService 2023-10-01 19:01:32,973 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36507] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-10-01 19:01:33,012 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-10-01 19:01:33,012 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-10-01 19:01:33,012 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-10-01 19:01:33,012 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-10-01 19:01:33,012 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-01 19:01:33,020 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-10-01 19:01:33,020 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-10-01 19:01:33,020 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-10-01 19:01:33,021 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-10-01 19:01:33,024 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 1.0300 sec 2023-10-01 19:01:33,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-01 19:01:33,107 INFO [Listener at jenkins-hbase4.apache.org/36885] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-10-01 19:01:33,111 DEBUG [Listener at jenkins-hbase4.apache.org/36885] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-10-01 19:01:33,112 DEBUG [Listener at jenkins-hbase4.apache.org/36885] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1696186891990.8d421dbf10e8d3a55ee096b22ebe703f. 2023-10-01 19:01:33,115 INFO [Listener at jenkins-hbase4.apache.org/36885] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-01 19:01:33,141 DEBUG [hconnection-0x6846c5bc-shared-pool-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 19:01:33,144 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40548, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 19:01:33,158 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-01 19:01:33,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696186893158 (current time:1696186893158). 2023-10-01 19:01:33,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-01 19:01:33,159 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(139): Connect 0x062145b8 to 127.0.0.1:55462 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 19:01:33,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1180307e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 19:01:33,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 19:01:33,170 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37132, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 19:01:33,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x062145b8 to 127.0.0.1:55462 2023-10-01 19:01:33,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 19:01:33,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(139): Connect 0x530901d8 to 127.0.0.1:55462 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 19:01:33,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1cb6d81e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 19:01:33,181 DEBUG [hconnection-0x1e785c1-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 19:01:33,184 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37146, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 19:01:33,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 19:01:33,191 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40550, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 19:01:33,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x530901d8 to 127.0.0.1:55462 2023-10-01 19:01:33,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 19:01:33,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-10-01 19:01:33,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-01 19:01:33,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-01 19:01:33,234 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot, current working dir path: hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-01 19:01:33,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] procedure2.ProcedureExecutor(1028): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-01 19:01:33,263 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-01 19:01:33,264 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1696187493264 2023-10-01 19:01:33,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-01 19:01:33,265 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-10-01 19:01:33,268 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-01 19:01:33,269 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-01 19:01:33,271 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 17 msec 2023-10-01 19:01:33,271 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-01 19:01:33,273 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1696187493273 2023-10-01 19:01:33,273 DEBUG [Listener at jenkins-hbase4.apache.org/36885] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-01 19:01:33,273 DEBUG [Listener at jenkins-hbase4.apache.org/36885] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-01 19:01:33,305 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-10-01 19:01:33,306 INFO [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-10-01 19:01:33,306 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 19:01:33,307 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-10-01 19:01:33,307 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-10-01 19:01:33,308 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-01 19:01:33,308 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-01 19:01:33,314 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 19:01:33,314 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 19:01:33,314 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 19:01:33,314 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 19:01:33,314 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 19:01:33,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 19:01:33,314 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 19:01:33,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 19:01:33,314 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:01:33,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 19:01:33,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-01 19:01:33,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-01 19:01:33,315 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:01:33,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-01 19:01:33,315 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:01:33,315 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-01 19:01:33,315 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-01 19:01:33,315 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-01 19:01:33,316 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:01:33,316 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-01 19:01:33,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-10-01 19:01:33,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-10-01 19:01:33,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-01 19:01:33,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-10-01 19:01:33,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-01 19:01:33,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-01 19:01:33,317 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-01 19:01:33,317 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-01 19:01:33,317 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-01 19:01:33,320 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-10-01 19:01:33,320 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-10-01 19:01:33,320 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-10-01 19:01:33,324 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-01 19:01:33,324 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 19:01:33,324 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-01 19:01:33,325 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-10-01 19:01:33,325 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44933,1696186884649' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-10-01 19:01:33,325 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-01 19:01:33,325 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 19:01:33,325 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-01 19:01:33,325 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-01 19:01:33,326 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-10-01 19:01:33,325 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 19:01:33,326 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46609,1696186884566' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-10-01 19:01:33,326 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-01 19:01:33,326 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-10-01 19:01:33,327 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36507,1696186884612' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-10-01 19:01:33,330 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-01 19:01:33,330 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-01 19:01:33,330 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-01 19:01:33,330 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-01 19:01:33,330 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:01:33,330 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 19:01:33,331 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:01:33,331 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-01 19:01:33,331 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-01 19:01:33,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:01:33,331 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 19:01:33,331 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 19:01:33,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 19:01:33,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 19:01:33,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 19:01:33,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 19:01:33,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-01 19:01:33,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:01:33,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:01:33,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:01:33,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 19:01:33,334 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36507,1696186884612' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-10-01 19:01:33,334 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@e1ff167[Count = 1] remaining members to acquire global barrier 2023-10-01 19:01:33,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:01:33,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 19:01:33,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 19:01:33,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 19:01:33,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 19:01:33,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-01 19:01:33,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:01:33,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:01:33,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:01:33,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 19:01:33,337 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44933,1696186884649' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-10-01 19:01:33,337 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@e1ff167[Count = 0] remaining members to acquire global barrier 2023-10-01 19:01:33,337 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-10-01 19:01:33,338 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-01 19:01:33,340 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-01 19:01:33,340 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-01 19:01:33,340 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-01 19:01:33,340 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-01 19:01:33,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-01 19:01:33,340 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:01:33,340 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-01 19:01:33,340 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-01 19:01:33,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-01 19:01:33,340 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-01 19:01:33,340 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-01 19:01:33,340 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:01:33,340 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-10-01 19:01:33,341 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-01 19:01:33,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-01 19:01:33,341 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,46609,1696186884566' in zk 2023-10-01 19:01:33,341 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-01 19:01:33,342 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 19:01:33,342 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1696186891990.6d8f208fed3946037503c43f340790cf. 2023-10-01 19:01:33,342 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 19:01:33,342 DEBUG [rs(jenkins-hbase4.apache.org,44933,1696186884649)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1696186891990.8d421dbf10e8d3a55ee096b22ebe703f. 2023-10-01 19:01:33,342 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 19:01:33,342 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 19:01:33,343 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1696186891990.6d8f208fed3946037503c43f340790cf. started... 2023-10-01 19:01:33,343 DEBUG [rs(jenkins-hbase4.apache.org,44933,1696186884649)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1696186891990.8d421dbf10e8d3a55ee096b22ebe703f. started... 2023-10-01 19:01:33,345 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-10-01 19:01:33,346 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 19:01:33,346 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-10-01 19:01:33,347 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6d8f208fed3946037503c43f340790cf: 2023-10-01 19:01:33,347 DEBUG [rs(jenkins-hbase4.apache.org,44933,1696186884649)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8d421dbf10e8d3a55ee096b22ebe703f: 2023-10-01 19:01:33,349 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1696186891990.6d8f208fed3946037503c43f340790cf.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-10-01 19:01:33,349 DEBUG [rs(jenkins-hbase4.apache.org,44933,1696186884649)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1696186891990.8d421dbf10e8d3a55ee096b22ebe703f.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-10-01 19:01:33,354 DEBUG [rs(jenkins-hbase4.apache.org,44933,1696186884649)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 19:01:33,354 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 19:01:33,358 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-01 19:01:33,358 DEBUG [rs(jenkins-hbase4.apache.org,44933,1696186884649)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-01 19:01:33,374 DEBUG [Listener at jenkins-hbase4.apache.org/36885] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 19:01:33,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-01 19:01:33,383 DEBUG [rs(jenkins-hbase4.apache.org,44933,1696186884649)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1696186891990.8d421dbf10e8d3a55ee096b22ebe703f. completed. 2023-10-01 19:01:33,383 DEBUG [rs(jenkins-hbase4.apache.org,44933,1696186884649)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1696186891990.8d421dbf10e8d3a55ee096b22ebe703f. 2023-10-01 19:01:33,384 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 19:01:33,387 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 19:01:33,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-10-01 19:01:33,387 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:01:33,387 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-10-01 19:01:33,387 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,44933,1696186884649' in zk 2023-10-01 19:01:33,387 DEBUG [Listener at jenkins-hbase4.apache.org/36885] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-01 19:01:33,391 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1696186891990.6d8f208fed3946037503c43f340790cf. completed. 2023-10-01 19:01:33,391 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1696186891990.6d8f208fed3946037503c43f340790cf. 2023-10-01 19:01:33,391 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 19:01:33,392 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 19:01:33,392 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:01:33,392 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-10-01 19:01:33,392 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,36507,1696186884612' in zk 2023-10-01 19:01:33,392 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-10-01 19:01:33,392 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:01:33,392 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 19:01:33,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:01:33,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 19:01:33,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 19:01:33,392 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-10-01 19:01:33,394 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-10-01 19:01:33,395 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:01:33,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 19:01:33,395 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 19:01:33,395 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-10-01 19:01:33,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 19:01:33,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-01 19:01:33,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:01:33,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:01:33,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:01:33,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 19:01:33,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-01 19:01:33,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:01:33,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:01:33,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:01:33,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,44933,1696186884649': 2023-10-01 19:01:33,400 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44933,1696186884649' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-10-01 19:01:33,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:01:33,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 19:01:33,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 19:01:33,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 19:01:33,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 19:01:33,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-01 19:01:33,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:01:33,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:01:33,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:01:33,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 19:01:33,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-01 19:01:33,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:01:33,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:01:33,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:01:33,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,36507,1696186884612': 2023-10-01 19:01:33,404 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36507,1696186884612' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-10-01 19:01:33,404 INFO [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-10-01 19:01:33,405 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-01 19:01:33,405 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-01 19:01:33,405 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-10-01 19:01:33,405 INFO [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-01 19:01:33,408 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-01 19:01:33,408 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-01 19:01:33,408 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-01 19:01:33,408 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-01 19:01:33,408 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-01 19:01:33,408 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 19:01:33,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-01 19:01:33,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 19:01:33,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 19:01:33,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-01 19:01:33,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-01 19:01:33,408 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-01 19:01:33,408 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 19:01:33,408 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-01 19:01:33,408 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 19:01:33,408 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:01:33,409 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 19:01:33,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-01 19:01:33,409 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 19:01:33,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 19:01:33,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 19:01:33,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 19:01:33,409 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:01:33,409 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 19:01:33,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-01 19:01:33,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-01 19:01:33,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 19:01:33,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-01 19:01:33,410 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:01:33,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-01 19:01:33,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 19:01:33,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-01 19:01:33,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:01:33,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:01:33,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:01:33,412 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:01:33,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 19:01:33,413 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:01:33,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-01 19:01:33,413 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:01:33,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:01:33,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:01:33,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:01:33,429 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 19:01:33,429 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:01:33,430 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 19:01:33,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 19:01:33,430 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 19:01:33,430 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 19:01:33,430 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-01 19:01:33,430 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 19:01:33,430 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:01:33,430 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 19:01:33,430 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 19:01:33,430 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 19:01:33,430 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-10-01 19:01:33,431 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-10-01 19:01:33,430 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 19:01:33,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 19:01:33,430 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 19:01:33,430 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:01:33,432 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-01 19:01:33,432 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:01:33,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 19:01:33,432 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-01 19:01:33,431 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-10-01 19:01:33,431 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 19:01:33,432 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-01 19:01:33,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 19:01:33,432 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:01:33,432 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:01:33,432 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-01 19:01:33,432 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-01 19:01:33,433 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 19:01:33,433 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 19:01:33,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 19:01:33,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 19:01:33,433 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-01 19:01:33,450 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-10-01 19:01:33,453 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-10-01 19:01:33,504 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-10-01 19:01:33,505 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-10-01 19:01:33,505 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-10-01 19:01:33,506 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-10-01 19:01:33,506 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1696186893265Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1696186893450 (+185 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1696186893450Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1696186893450Writing data manifest for emptySnaptb0-testExportWithTargetName at 1696186893462 (+12 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1696186893493 (+31 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1696186893505 (+12 ms) 2023-10-01 19:01:33,508 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-01 19:01:33,511 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 242 msec 2023-10-01 19:01:33,539 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 19:01:33,543 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-10-01 19:01:33,543 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 19:01:33,543 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-10-01 19:01:33,544 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-10-01 19:01:33,544 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-10-01 19:01:33,544 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 19:01:33,544 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-10-01 19:01:33,544 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-10-01 19:01:33,544 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-10-01 19:01:33,588 DEBUG [Listener at jenkins-hbase4.apache.org/36885] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 19:01:33,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-01 19:01:33,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-01 19:01:33,604 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44933] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1696186891990.8d421dbf10e8d3a55ee096b22ebe703f. with WAL disabled. Data may be lost in the event of a crash. 2023-10-01 19:01:33,607 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36507] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1696186891990.6d8f208fed3946037503c43f340790cf. with WAL disabled. Data may be lost in the event of a crash. 2023-10-01 19:01:33,613 DEBUG [Listener at jenkins-hbase4.apache.org/36885] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-10-01 19:01:33,613 DEBUG [Listener at jenkins-hbase4.apache.org/36885] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1696186891990.8d421dbf10e8d3a55ee096b22ebe703f. 2023-10-01 19:01:33,613 INFO [Listener at jenkins-hbase4.apache.org/36885] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-01 19:01:33,628 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-01 19:01:33,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696186893628 (current time:1696186893628). 2023-10-01 19:01:33,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-01 19:01:33,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(139): Connect 0x63d518f2 to 127.0.0.1:55462 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 19:01:33,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3de2d7d7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 19:01:33,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 19:01:33,640 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37148, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 19:01:33,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x63d518f2 to 127.0.0.1:55462 2023-10-01 19:01:33,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 19:01:33,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(139): Connect 0x585bb37c to 127.0.0.1:55462 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 19:01:33,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1382320d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 19:01:33,649 DEBUG [hconnection-0x387503c5-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 19:01:33,650 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37158, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 19:01:33,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 19:01:33,656 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40562, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 19:01:33,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x585bb37c to 127.0.0.1:55462 2023-10-01 19:01:33,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 19:01:33,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-10-01 19:01:33,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-01 19:01:33,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-01 19:01:33,661 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot, current working dir path: hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-01 19:01:33,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] procedure2.ProcedureExecutor(1028): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-01 19:01:33,665 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-01 19:01:33,666 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1696187493666 2023-10-01 19:01:33,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-01 19:01:33,666 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-10-01 19:01:33,667 DEBUG [Listener at jenkins-hbase4.apache.org/36885] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-01 19:01:33,667 DEBUG [Listener at jenkins-hbase4.apache.org/36885] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-01 19:01:33,668 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-01 19:01:33,668 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-01 19:01:33,670 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 6 msec 2023-10-01 19:01:33,671 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-01 19:01:33,672 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1696187493672 2023-10-01 19:01:33,688 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-10-01 19:01:33,688 INFO [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-10-01 19:01:33,688 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 19:01:33,689 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-10-01 19:01:33,689 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-10-01 19:01:33,690 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-01 19:01:33,690 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-01 19:01:33,691 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 19:01:33,691 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 19:01:33,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 19:01:33,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 19:01:33,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 19:01:33,691 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 19:01:33,691 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:01:33,692 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 19:01:33,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 19:01:33,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 19:01:33,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-01 19:01:33,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-01 19:01:33,692 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:01:33,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-01 19:01:33,692 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-01 19:01:33,692 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:01:33,693 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-01 19:01:33,693 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-01 19:01:33,693 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:01:33,693 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-01 19:01:33,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-10-01 19:01:33,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-01 19:01:33,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-10-01 19:01:33,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-10-01 19:01:33,693 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-01 19:01:33,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-01 19:01:33,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-01 19:01:33,694 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-01 19:01:33,694 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-10-01 19:01:33,694 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-01 19:01:33,694 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-01 19:01:33,694 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 19:01:33,694 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-10-01 19:01:33,695 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-01 19:01:33,695 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-10-01 19:01:33,695 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36507,1696186884612' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-10-01 19:01:33,695 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-10-01 19:01:33,695 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-01 19:01:33,695 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 19:01:33,695 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-01 19:01:33,696 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-01 19:01:33,696 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-10-01 19:01:33,696 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 19:01:33,696 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44933,1696186884649' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-10-01 19:01:33,697 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-01 19:01:33,697 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-10-01 19:01:33,697 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46609,1696186884566' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-10-01 19:01:33,699 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-01 19:01:33,699 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:01:33,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:01:33,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 19:01:33,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 19:01:33,701 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:01:33,701 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-01 19:01:33,701 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-01 19:01:33,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 19:01:33,701 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-01 19:01:33,701 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 19:01:33,701 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-01 19:01:33,701 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 19:01:33,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 19:01:33,702 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-01 19:01:33,702 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 19:01:33,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-01 19:01:33,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:01:33,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:01:33,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:01:33,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 19:01:33,704 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36507,1696186884612' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-10-01 19:01:33,704 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7c82a7d3[Count = 1] remaining members to acquire global barrier 2023-10-01 19:01:33,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:01:33,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 19:01:33,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 19:01:33,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 19:01:33,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 19:01:33,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-01 19:01:33,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:01:33,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:01:33,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:01:33,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 19:01:33,707 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44933,1696186884649' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-10-01 19:01:33,707 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7c82a7d3[Count = 0] remaining members to acquire global barrier 2023-10-01 19:01:33,707 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-10-01 19:01:33,707 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-01 19:01:33,711 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-01 19:01:33,711 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-01 19:01:33,711 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-01 19:01:33,711 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-01 19:01:33,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-01 19:01:33,711 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-01 19:01:33,712 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-01 19:01:33,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-01 19:01:33,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-01 19:01:33,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-01 19:01:33,712 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-01 19:01:33,712 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-10-01 19:01:33,712 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,46609,1696186884566' in zk 2023-10-01 19:01:33,712 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1696186891990.6d8f208fed3946037503c43f340790cf. 2023-10-01 19:01:33,712 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:01:33,712 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 19:01:33,712 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 19:01:33,712 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-01 19:01:33,712 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1696186891990.6d8f208fed3946037503c43f340790cf. started... 2023-10-01 19:01:33,712 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 19:01:33,713 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 19:01:33,712 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:01:33,713 INFO [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 6d8f208fed3946037503c43f340790cf 1/1 column families, dataSize=3.19 KB heapSize=7.14 KB 2023-10-01 19:01:33,713 DEBUG [rs(jenkins-hbase4.apache.org,44933,1696186884649)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1696186891990.8d421dbf10e8d3a55ee096b22ebe703f. 2023-10-01 19:01:33,713 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-01 19:01:33,713 DEBUG [rs(jenkins-hbase4.apache.org,44933,1696186884649)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1696186891990.8d421dbf10e8d3a55ee096b22ebe703f. started... 2023-10-01 19:01:33,713 INFO [rs(jenkins-hbase4.apache.org,44933,1696186884649)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 8d421dbf10e8d3a55ee096b22ebe703f 1/1 column families, dataSize=65 B heapSize=400 B 2023-10-01 19:01:33,715 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-10-01 19:01:33,715 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 19:01:33,715 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-10-01 19:01:33,767 DEBUG [Listener at jenkins-hbase4.apache.org/36885] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 19:01:33,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-01 19:01:33,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-10-01 19:01:33,769 DEBUG [Listener at jenkins-hbase4.apache.org/36885] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-01 19:01:33,849 INFO [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231001f1a006eef4d9440da896453d3abaa34e to hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20231001f1a006eef4d9440da896453d3abaa34e 2023-10-01 19:01:33,849 INFO [rs(jenkins-hbase4.apache.org,44933,1696186884649)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310013667bfdb2ea94526af87ad1a9f3fbfa1 to hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202310013667bfdb2ea94526af87ad1a9f3fbfa1 2023-10-01 19:01:33,880 INFO [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.2 K, hasBloomFilter=true, into tmp file hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportWithTargetName/6d8f208fed3946037503c43f340790cf/.tmp/cf/c81379cf6b894fc19d224b6f7975850a 2023-10-01 19:01:33,882 INFO [rs(jenkins-hbase4.apache.org,44933,1696186884649)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=65, hasBloomFilter=true, into tmp file hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportWithTargetName/8d421dbf10e8d3a55ee096b22ebe703f/.tmp/cf/763509164c834f03b5a4c2c844681d87 2023-10-01 19:01:33,893 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportWithTargetName/6d8f208fed3946037503c43f340790cf/.tmp/cf/c81379cf6b894fc19d224b6f7975850a as hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportWithTargetName/6d8f208fed3946037503c43f340790cf/cf/c81379cf6b894fc19d224b6f7975850a 2023-10-01 19:01:33,893 DEBUG [rs(jenkins-hbase4.apache.org,44933,1696186884649)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportWithTargetName/8d421dbf10e8d3a55ee096b22ebe703f/.tmp/cf/763509164c834f03b5a4c2c844681d87 as hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportWithTargetName/8d421dbf10e8d3a55ee096b22ebe703f/cf/763509164c834f03b5a4c2c844681d87 2023-10-01 19:01:33,903 INFO [rs(jenkins-hbase4.apache.org,44933,1696186884649)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportWithTargetName/8d421dbf10e8d3a55ee096b22ebe703f/cf/763509164c834f03b5a4c2c844681d87, entries=1, sequenceid=6, filesize=5.1 K 2023-10-01 19:01:33,903 INFO [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportWithTargetName/6d8f208fed3946037503c43f340790cf/cf/c81379cf6b894fc19d224b6f7975850a, entries=49, sequenceid=6, filesize=13.1 K 2023-10-01 19:01:33,907 INFO [rs(jenkins-hbase4.apache.org,44933,1696186884649)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~65 B/65, heapSize ~384 B/384, currentSize=0 B/0 for 8d421dbf10e8d3a55ee096b22ebe703f in 194ms, sequenceid=6, compaction requested=false 2023-10-01 19:01:33,907 INFO [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.19 KB/3271, heapSize ~7.13 KB/7296, currentSize=0 B/0 for 6d8f208fed3946037503c43f340790cf in 194ms, sequenceid=6, compaction requested=false 2023-10-01 19:01:33,907 DEBUG [rs(jenkins-hbase4.apache.org,44933,1696186884649)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-10-01 19:01:33,907 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-10-01 19:01:33,909 DEBUG [rs(jenkins-hbase4.apache.org,44933,1696186884649)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8d421dbf10e8d3a55ee096b22ebe703f: 2023-10-01 19:01:33,909 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6d8f208fed3946037503c43f340790cf: 2023-10-01 19:01:33,910 DEBUG [rs(jenkins-hbase4.apache.org,44933,1696186884649)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1696186891990.8d421dbf10e8d3a55ee096b22ebe703f.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-10-01 19:01:33,910 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1696186891990.6d8f208fed3946037503c43f340790cf.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-10-01 19:01:33,910 DEBUG [rs(jenkins-hbase4.apache.org,44933,1696186884649)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 19:01:33,910 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 19:01:33,910 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportWithTargetName/6d8f208fed3946037503c43f340790cf/cf/c81379cf6b894fc19d224b6f7975850a] hfiles 2023-10-01 19:01:33,910 DEBUG [rs(jenkins-hbase4.apache.org,44933,1696186884649)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportWithTargetName/8d421dbf10e8d3a55ee096b22ebe703f/cf/763509164c834f03b5a4c2c844681d87] hfiles 2023-10-01 19:01:33,910 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportWithTargetName/6d8f208fed3946037503c43f340790cf/cf/c81379cf6b894fc19d224b6f7975850a for snapshot=snaptb0-testExportWithTargetName 2023-10-01 19:01:33,910 DEBUG [rs(jenkins-hbase4.apache.org,44933,1696186884649)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportWithTargetName/8d421dbf10e8d3a55ee096b22ebe703f/cf/763509164c834f03b5a4c2c844681d87 for snapshot=snaptb0-testExportWithTargetName 2023-10-01 19:01:33,937 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1696186891990.6d8f208fed3946037503c43f340790cf. completed. 2023-10-01 19:01:33,937 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1696186891990.6d8f208fed3946037503c43f340790cf. 2023-10-01 19:01:33,937 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 19:01:33,938 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 19:01:33,938 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:01:33,938 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-10-01 19:01:33,938 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,36507,1696186884612' in zk 2023-10-01 19:01:33,938 DEBUG [rs(jenkins-hbase4.apache.org,44933,1696186884649)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1696186891990.8d421dbf10e8d3a55ee096b22ebe703f. completed. 2023-10-01 19:01:33,938 DEBUG [rs(jenkins-hbase4.apache.org,44933,1696186884649)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1696186891990.8d421dbf10e8d3a55ee096b22ebe703f. 2023-10-01 19:01:33,938 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 19:01:33,938 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 19:01:33,938 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:01:33,939 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-10-01 19:01:33,939 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,44933,1696186884649' in zk 2023-10-01 19:01:33,940 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:01:33,940 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-10-01 19:01:33,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:01:33,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 19:01:33,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 19:01:33,940 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 19:01:33,940 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-10-01 19:01:33,942 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:01:33,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 19:01:33,942 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-10-01 19:01:33,943 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 19:01:33,943 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-10-01 19:01:33,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 19:01:33,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-01 19:01:33,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:01:33,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:01:33,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:01:33,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 19:01:33,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-01 19:01:33,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:01:33,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:01:33,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:01:33,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,36507,1696186884612': 2023-10-01 19:01:33,948 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36507,1696186884612' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-10-01 19:01:33,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:01:33,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 19:01:33,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 19:01:33,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 19:01:33,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 19:01:33,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-01 19:01:33,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:01:33,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:01:33,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:01:33,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 19:01:33,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-01 19:01:33,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:01:33,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:01:33,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:01:33,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,44933,1696186884649': 2023-10-01 19:01:33,952 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44933,1696186884649' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-10-01 19:01:33,952 INFO [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-10-01 19:01:33,952 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-01 19:01:33,952 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-01 19:01:33,952 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-10-01 19:01:33,952 INFO [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-01 19:01:33,955 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-01 19:01:33,955 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-01 19:01:33,955 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-01 19:01:33,955 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-01 19:01:33,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-01 19:01:33,955 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-01 19:01:33,955 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 19:01:33,956 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-01 19:01:33,955 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-01 19:01:33,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-01 19:01:33,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-01 19:01:33,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 19:01:33,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 19:01:33,955 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 19:01:33,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-01 19:01:33,956 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:01:33,955 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 19:01:33,956 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 19:01:33,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 19:01:33,956 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 19:01:33,956 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 19:01:33,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 19:01:33,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 19:01:33,956 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:01:33,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 19:01:33,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-01 19:01:33,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-01 19:01:33,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-01 19:01:33,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-01 19:01:33,957 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:01:33,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 19:01:33,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-01 19:01:33,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:01:33,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:01:33,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:01:33,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 19:01:33,960 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:01:33,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-01 19:01:33,960 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:01:33,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:01:33,960 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:01:33,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:01:33,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:01:33,971 DEBUG [Listener at jenkins-hbase4.apache.org/36885] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 19:01:33,972 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 19:01:33,973 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 19:01:33,973 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 19:01:33,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-01 19:01:33,973 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 19:01:33,973 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 19:01:33,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-10-01 19:01:33,973 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 19:01:33,973 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 19:01:33,973 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 19:01:33,974 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 19:01:33,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 19:01:33,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 19:01:33,973 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:01:33,974 DEBUG [Listener at jenkins-hbase4.apache.org/36885] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-10-01 19:01:33,974 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 19:01:33,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 19:01:33,973 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-10-01 19:01:33,974 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 19:01:33,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 19:01:33,974 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-10-01 19:01:33,974 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 19:01:33,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 19:01:33,974 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-01 19:01:33,975 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-10-01 19:01:33,975 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 19:01:33,975 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-01 19:01:33,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 19:01:33,975 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:01:33,975 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:01:33,975 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-01 19:01:33,975 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:01:33,975 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-01 19:01:33,975 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:01:33,975 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:01:33,975 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-01 19:01:33,975 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-01 19:01:33,976 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20231001f1a006eef4d9440da896453d3abaa34e, hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202310013667bfdb2ea94526af87ad1a9f3fbfa1] mob files 2023-10-01 19:01:33,976 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20231001f1a006eef4d9440da896453d3abaa34e 2023-10-01 19:01:33,976 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202310013667bfdb2ea94526af87ad1a9f3fbfa1 2023-10-01 19:01:33,992 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-10-01 19:01:33,993 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-10-01 19:01:34,042 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-10-01 19:01:34,043 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-10-01 19:01:34,043 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-10-01 19:01:34,044 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-10-01 19:01:34,044 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1696186893666Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1696186893992 (+326 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1696186893992Loading Region manifests for snaptb0-testExportWithTargetName at 1696186893992Writing data manifest for snaptb0-testExportWithTargetName at 1696186894006 (+14 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1696186894030 (+24 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1696186894043 (+13 ms) 2023-10-01 19:01:34,046 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-01 19:01:34,049 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 380 msec 2023-10-01 19:01:34,274 DEBUG [Listener at jenkins-hbase4.apache.org/36885] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 19:01:34,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-01 19:01:34,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-01 19:01:34,278 INFO [Listener at jenkins-hbase4.apache.org/36885] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/export-test/export-1696186894278 2023-10-01 19:01:34,278 INFO [Listener at jenkins-hbase4.apache.org/36885] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:38933, tgtDir=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/export-test/export-1696186894278, rawTgtDir=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/export-test/export-1696186894278, srcFsUri=hdfs://localhost:38933, srcDir=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399 2023-10-01 19:01:34,320 DEBUG [Listener at jenkins-hbase4.apache.org/36885] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:38933, inputRoot=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399 2023-10-01 19:01:34,320 DEBUG [Listener at jenkins-hbase4.apache.org/36885] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_663463582_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/export-test/export-1696186894278, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/export-test/export-1696186894278/.hbase-snapshot/.tmp/testExportWithTargetName 2023-10-01 19:01:34,320 INFO [Listener at jenkins-hbase4.apache.org/36885] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:38933, inputRoot=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399, snapshotDir=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-10-01 19:01:34,343 INFO [Listener at jenkins-hbase4.apache.org/36885] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/export-test/export-1696186894278/.hbase-snapshot/.tmp/testExportWithTargetName 2023-10-01 19:01:34,409 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-01 19:01:34,410 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-01 19:01:34,411 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-01 19:01:34,411 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-01 19:01:35,356 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba/hadoop-3729543902962016100.jar 2023-10-01 19:01:35,357 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-01 19:01:35,357 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-01 19:01:35,424 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba/hadoop-1679439024710329371.jar 2023-10-01 19:01:35,425 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-01 19:01:35,425 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-01 19:01:35,426 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-01 19:01:35,426 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-01 19:01:35,427 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-01 19:01:35,427 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-01 19:01:35,428 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-01 19:01:35,428 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-01 19:01:35,429 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-01 19:01:35,429 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-01 19:01:35,429 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-01 19:01:35,430 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-01 19:01:35,430 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-01 19:01:35,431 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-01 19:01:35,431 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-01 19:01:35,432 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-01 19:01:35,436 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 19:01:35,436 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 19:01:35,436 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 19:01:35,437 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 19:01:35,437 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 19:01:35,438 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 19:01:35,438 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 19:01:36,249 WARN [Listener at jenkins-hbase4.apache.org/36885] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-01 19:01:36,254 INFO [Listener at jenkins-hbase4.apache.org/36885] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-10-01 19:01:36,262 DEBUG [Listener at jenkins-hbase4.apache.org/36885] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-10-01 19:01:36,757 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-01 19:01:36,758 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-01 19:01:37,067 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696186890860_0001_000001 (auth:SIMPLE) 2023-10-01 19:01:38,381 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-01 19:01:41,500 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696186890860_0001_000001 (auth:SIMPLE) 2023-10-01 19:01:43,782 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696186890860_0001_000001 (auth:SIMPLE) 2023-10-01 19:01:47,224 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696186890860_0001_000001 (auth:SIMPLE) 2023-10-01 19:01:49,167 INFO [Listener at jenkins-hbase4.apache.org/36885] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-01 19:01:49,171 INFO [Listener at jenkins-hbase4.apache.org/36885] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-01 19:01:49,181 INFO [Listener at jenkins-hbase4.apache.org/36885] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-10-01 19:01:49,181 INFO [Listener at jenkins-hbase4.apache.org/36885] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-01 19:01:49,182 INFO [Listener at jenkins-hbase4.apache.org/36885] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-01 19:01:49,182 DEBUG [Listener at jenkins-hbase4.apache.org/36885] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-628947520_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-10-01 19:01:49,182 DEBUG [Listener at jenkins-hbase4.apache.org/36885] snapshot.TestExportSnapshot(367): hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-10-01 19:01:49,183 DEBUG [Listener at jenkins-hbase4.apache.org/36885] snapshot.TestExportSnapshot(367): hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-10-01 19:01:49,183 DEBUG [Listener at jenkins-hbase4.apache.org/36885] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-628947520_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/export-test/export-1696186894278/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/export-test/export-1696186894278/.hbase-snapshot/testExportWithTargetName 2023-10-01 19:01:49,183 DEBUG [Listener at jenkins-hbase4.apache.org/36885] snapshot.TestExportSnapshot(367): hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/export-test/export-1696186894278/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-10-01 19:01:49,183 DEBUG [Listener at jenkins-hbase4.apache.org/36885] snapshot.TestExportSnapshot(367): hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/export-test/export-1696186894278/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-10-01 19:01:49,194 INFO [Listener at jenkins-hbase4.apache.org/36885] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-10-01 19:01:49,199 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-10-01 19:01:49,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] procedure2.ProcedureExecutor(1028): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-10-01 19:01:49,212 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696186909212"}]},"ts":"1696186909212"} 2023-10-01 19:01:49,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-10-01 19:01:49,214 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-10-01 19:01:49,216 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-10-01 19:01:49,218 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=8d421dbf10e8d3a55ee096b22ebe703f, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=6d8f208fed3946037503c43f340790cf, UNASSIGN}] 2023-10-01 19:01:49,221 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=8d421dbf10e8d3a55ee096b22ebe703f, UNASSIGN 2023-10-01 19:01:49,221 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=6d8f208fed3946037503c43f340790cf, UNASSIGN 2023-10-01 19:01:49,222 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=8d421dbf10e8d3a55ee096b22ebe703f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:01:49,222 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=6d8f208fed3946037503c43f340790cf, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:01:49,222 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1696186891990.8d421dbf10e8d3a55ee096b22ebe703f.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696186909222"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696186909222"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696186909222"}]},"ts":"1696186909222"} 2023-10-01 19:01:49,222 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1696186891990.6d8f208fed3946037503c43f340790cf.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696186909222"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696186909222"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696186909222"}]},"ts":"1696186909222"} 2023-10-01 19:01:49,224 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure 8d421dbf10e8d3a55ee096b22ebe703f, server=jenkins-hbase4.apache.org,44933,1696186884649}] 2023-10-01 19:01:49,225 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure 6d8f208fed3946037503c43f340790cf, server=jenkins-hbase4.apache.org,36507,1696186884612}] 2023-10-01 19:01:49,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-10-01 19:01:49,387 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 8d421dbf10e8d3a55ee096b22ebe703f 2023-10-01 19:01:49,387 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 6d8f208fed3946037503c43f340790cf 2023-10-01 19:01:49,387 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 8d421dbf10e8d3a55ee096b22ebe703f, disabling compactions & flushes 2023-10-01 19:01:49,387 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6d8f208fed3946037503c43f340790cf, disabling compactions & flushes 2023-10-01 19:01:49,414 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1696186891990.8d421dbf10e8d3a55ee096b22ebe703f. 2023-10-01 19:01:49,414 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1696186891990.8d421dbf10e8d3a55ee096b22ebe703f. 2023-10-01 19:01:49,414 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1696186891990.6d8f208fed3946037503c43f340790cf. 2023-10-01 19:01:49,414 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1696186891990.6d8f208fed3946037503c43f340790cf. 2023-10-01 19:01:49,415 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1696186891990.6d8f208fed3946037503c43f340790cf. after waiting 0 ms 2023-10-01 19:01:49,414 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1696186891990.8d421dbf10e8d3a55ee096b22ebe703f. after waiting 0 ms 2023-10-01 19:01:49,415 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1696186891990.8d421dbf10e8d3a55ee096b22ebe703f. 2023-10-01 19:01:49,415 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1696186891990.6d8f208fed3946037503c43f340790cf. 2023-10-01 19:01:49,432 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportWithTargetName/6d8f208fed3946037503c43f340790cf/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-01 19:01:49,433 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportWithTargetName/8d421dbf10e8d3a55ee096b22ebe703f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-01 19:01:49,433 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 19:01:49,433 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 19:01:49,435 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1696186891990.8d421dbf10e8d3a55ee096b22ebe703f. 2023-10-01 19:01:49,435 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1696186891990.6d8f208fed3946037503c43f340790cf. 2023-10-01 19:01:49,435 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 8d421dbf10e8d3a55ee096b22ebe703f: 2023-10-01 19:01:49,435 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6d8f208fed3946037503c43f340790cf: 2023-10-01 19:01:49,437 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 6d8f208fed3946037503c43f340790cf 2023-10-01 19:01:49,438 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=6d8f208fed3946037503c43f340790cf, regionState=CLOSED 2023-10-01 19:01:49,438 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1696186891990.6d8f208fed3946037503c43f340790cf.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696186909438"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696186909438"}]},"ts":"1696186909438"} 2023-10-01 19:01:49,438 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 8d421dbf10e8d3a55ee096b22ebe703f 2023-10-01 19:01:49,439 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=8d421dbf10e8d3a55ee096b22ebe703f, regionState=CLOSED 2023-10-01 19:01:49,440 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1696186891990.8d421dbf10e8d3a55ee096b22ebe703f.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696186909439"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696186909439"}]},"ts":"1696186909439"} 2023-10-01 19:01:49,443 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=25, resume processing ppid=23 2023-10-01 19:01:49,443 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure 6d8f208fed3946037503c43f340790cf, server=jenkins-hbase4.apache.org,36507,1696186884612 in 215 msec 2023-10-01 19:01:49,444 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=24, resume processing ppid=22 2023-10-01 19:01:49,444 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure 8d421dbf10e8d3a55ee096b22ebe703f, server=jenkins-hbase4.apache.org,44933,1696186884649 in 217 msec 2023-10-01 19:01:49,445 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=6d8f208fed3946037503c43f340790cf, UNASSIGN in 225 msec 2023-10-01 19:01:49,446 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=22, resume processing ppid=21 2023-10-01 19:01:49,447 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=8d421dbf10e8d3a55ee096b22ebe703f, UNASSIGN in 226 msec 2023-10-01 19:01:49,448 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696186909448"}]},"ts":"1696186909448"} 2023-10-01 19:01:49,449 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-10-01 19:01:49,451 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-10-01 19:01:49,453 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 250 msec 2023-10-01 19:01:49,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-10-01 19:01:49,516 INFO [Listener at jenkins-hbase4.apache.org/36885] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-10-01 19:01:49,523 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-10-01 19:01:49,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] procedure2.ProcedureExecutor(1028): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-01 19:01:49,533 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-01 19:01:49,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-10-01 19:01:49,535 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-01 19:01:49,539 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36507] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-10-01 19:01:49,541 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportWithTargetName/8d421dbf10e8d3a55ee096b22ebe703f 2023-10-01 19:01:49,541 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportWithTargetName/6d8f208fed3946037503c43f340790cf 2023-10-01 19:01:49,542 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-01 19:01:49,543 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-01 19:01:49,543 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-01 19:01:49,543 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-01 19:01:49,544 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 19:01:49,544 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-10-01 19:01:49,544 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 19:01:49,544 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-01 19:01:49,544 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-10-01 19:01:49,544 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-01 19:01:49,545 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 19:01:49,545 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-10-01 19:01:49,545 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-01 19:01:49,545 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 19:01:49,545 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-10-01 19:01:49,545 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-01 19:01:49,545 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportWithTargetName/6d8f208fed3946037503c43f340790cf/cf, FileablePath, hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportWithTargetName/6d8f208fed3946037503c43f340790cf/recovered.edits] 2023-10-01 19:01:49,545 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportWithTargetName/8d421dbf10e8d3a55ee096b22ebe703f/cf, FileablePath, hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportWithTargetName/8d421dbf10e8d3a55ee096b22ebe703f/recovered.edits] 2023-10-01 19:01:49,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-10-01 19:01:49,553 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportWithTargetName/6d8f208fed3946037503c43f340790cf/cf/c81379cf6b894fc19d224b6f7975850a to hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/archive/data/default/testtb-testExportWithTargetName/6d8f208fed3946037503c43f340790cf/cf/c81379cf6b894fc19d224b6f7975850a 2023-10-01 19:01:49,554 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportWithTargetName/8d421dbf10e8d3a55ee096b22ebe703f/cf/763509164c834f03b5a4c2c844681d87 to hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/archive/data/default/testtb-testExportWithTargetName/8d421dbf10e8d3a55ee096b22ebe703f/cf/763509164c834f03b5a4c2c844681d87 2023-10-01 19:01:49,558 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportWithTargetName/8d421dbf10e8d3a55ee096b22ebe703f/recovered.edits/9.seqid to hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/archive/data/default/testtb-testExportWithTargetName/8d421dbf10e8d3a55ee096b22ebe703f/recovered.edits/9.seqid 2023-10-01 19:01:49,558 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportWithTargetName/6d8f208fed3946037503c43f340790cf/recovered.edits/9.seqid to hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/archive/data/default/testtb-testExportWithTargetName/6d8f208fed3946037503c43f340790cf/recovered.edits/9.seqid 2023-10-01 19:01:49,559 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportWithTargetName/8d421dbf10e8d3a55ee096b22ebe703f 2023-10-01 19:01:49,559 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportWithTargetName/6d8f208fed3946037503c43f340790cf 2023-10-01 19:01:49,559 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-10-01 19:01:49,559 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-10-01 19:01:49,560 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-10-01 19:01:49,564 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20231001f1a006eef4d9440da896453d3abaa34e to hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20231001f1a006eef4d9440da896453d3abaa34e 2023-10-01 19:01:49,566 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202310013667bfdb2ea94526af87ad1a9f3fbfa1 to hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202310013667bfdb2ea94526af87ad1a9f3fbfa1 2023-10-01 19:01:49,566 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-10-01 19:01:49,569 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-01 19:01:49,590 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-10-01 19:01:49,593 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-10-01 19:01:49,595 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-01 19:01:49,595 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-10-01 19:01:49,595 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1696186891990.8d421dbf10e8d3a55ee096b22ebe703f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696186909595"}]},"ts":"9223372036854775807"} 2023-10-01 19:01:49,595 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1696186891990.6d8f208fed3946037503c43f340790cf.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696186909595"}]},"ts":"9223372036854775807"} 2023-10-01 19:01:49,598 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-01 19:01:49,598 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 8d421dbf10e8d3a55ee096b22ebe703f, NAME => 'testtb-testExportWithTargetName,,1696186891990.8d421dbf10e8d3a55ee096b22ebe703f.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 6d8f208fed3946037503c43f340790cf, NAME => 'testtb-testExportWithTargetName,1,1696186891990.6d8f208fed3946037503c43f340790cf.', STARTKEY => '1', ENDKEY => ''}] 2023-10-01 19:01:49,598 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-10-01 19:01:49,598 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696186909598"}]},"ts":"9223372036854775807"} 2023-10-01 19:01:49,600 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-10-01 19:01:49,603 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-01 19:01:49,604 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 79 msec 2023-10-01 19:01:49,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-10-01 19:01:49,652 INFO [Listener at jenkins-hbase4.apache.org/36885] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-10-01 19:01:49,670 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-10-01 19:01:49,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-10-01 19:01:49,675 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-10-01 19:01:49,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportWithTargetName 2023-10-01 19:01:49,709 INFO [Listener at jenkins-hbase4.apache.org/36885] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=752 (was 703) Potentially hanging thread: ContainersLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba/cluster_4acb6892-f4ef-d33f-00bc-9c8e7df86da3/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (32912118) connection to jenkins-hbase4.apache.org/172.31.14.131:39303 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Timer for 'JobHistoryServer' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba/cluster_4acb6892-f4ef-d33f-00bc-9c8e7df86da3/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-628947520_17 at /127.0.0.1:43710 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba/cluster_4acb6892-f4ef-d33f-00bc-9c8e7df86da3/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (32912118) connection to jenkins-hbase4.apache.org/172.31.14.131:35609 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: (jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x618534e4-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-628947520_17 at /127.0.0.1:52986 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1658238750_1 at /127.0.0.1:52520 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-628947520_17 at /127.0.0.1:52554 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba/cluster_4acb6892-f4ef-d33f-00bc-9c8e7df86da3/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x618534e4-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1282 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba/cluster_4acb6892-f4ef-d33f-00bc-9c8e7df86da3/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x618534e4-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x618534e4-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: IPC Client (32912118) connection to jenkins-hbase4.apache.org/172.31.14.131:35441 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba/cluster_4acb6892-f4ef-d33f-00bc-9c8e7df86da3/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=931 (was 898) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=151 (was 134) - SystemLoadAverage LEAK? -, ProcessCount=167 (was 164) - ProcessCount LEAK? -, AvailableMemoryMB=1558 (was 2382) 2023-10-01 19:01:49,709 WARN [Listener at jenkins-hbase4.apache.org/36885] hbase.ResourceChecker(130): Thread=752 is superior to 500 2023-10-01 19:01:49,732 INFO [Listener at jenkins-hbase4.apache.org/36885] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=752, OpenFileDescriptor=931, MaxFileDescriptor=60000, SystemLoadAverage=151, ProcessCount=167, AvailableMemoryMB=1557 2023-10-01 19:01:49,732 WARN [Listener at jenkins-hbase4.apache.org/36885] hbase.ResourceChecker(130): Thread=752 is superior to 500 2023-10-01 19:01:49,734 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-01 19:01:49,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] procedure2.ProcedureExecutor(1028): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-10-01 19:01:49,739 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-10-01 19:01:49,740 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-10-01 19:01:49,741 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-01 19:01:49,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-01 19:01:49,744 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportFileSystemState/59dc6410fd5990fd1cdd946339c84185 2023-10-01 19:01:49,744 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportFileSystemState/213160f7f7d3652e366f4b3f050cf2eb 2023-10-01 19:01:49,744 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportFileSystemState/213160f7f7d3652e366f4b3f050cf2eb empty. 2023-10-01 19:01:49,744 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportFileSystemState/59dc6410fd5990fd1cdd946339c84185 empty. 2023-10-01 19:01:49,745 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportFileSystemState/213160f7f7d3652e366f4b3f050cf2eb 2023-10-01 19:01:49,745 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportFileSystemState/59dc6410fd5990fd1cdd946339c84185 2023-10-01 19:01:49,745 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-10-01 19:01:49,756 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-10-01 19:01:49,758 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 59dc6410fd5990fd1cdd946339c84185, NAME => 'testtb-testExportFileSystemState,,1696186909733.59dc6410fd5990fd1cdd946339c84185.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp 2023-10-01 19:01:49,761 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 213160f7f7d3652e366f4b3f050cf2eb, NAME => 'testtb-testExportFileSystemState,1,1696186909733.213160f7f7d3652e366f4b3f050cf2eb.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp 2023-10-01 19:01:49,794 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1696186909733.59dc6410fd5990fd1cdd946339c84185.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 19:01:49,795 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 59dc6410fd5990fd1cdd946339c84185, disabling compactions & flushes 2023-10-01 19:01:49,795 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1696186909733.59dc6410fd5990fd1cdd946339c84185. 2023-10-01 19:01:49,795 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1696186909733.59dc6410fd5990fd1cdd946339c84185. 2023-10-01 19:01:49,795 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1696186909733.59dc6410fd5990fd1cdd946339c84185. after waiting 0 ms 2023-10-01 19:01:49,795 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1696186909733.59dc6410fd5990fd1cdd946339c84185. 2023-10-01 19:01:49,795 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1696186909733.59dc6410fd5990fd1cdd946339c84185. 2023-10-01 19:01:49,795 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 59dc6410fd5990fd1cdd946339c84185: 2023-10-01 19:01:49,795 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1696186909733.213160f7f7d3652e366f4b3f050cf2eb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 19:01:49,796 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 213160f7f7d3652e366f4b3f050cf2eb, disabling compactions & flushes 2023-10-01 19:01:49,796 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1696186909733.213160f7f7d3652e366f4b3f050cf2eb. 2023-10-01 19:01:49,796 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1696186909733.213160f7f7d3652e366f4b3f050cf2eb. 2023-10-01 19:01:49,796 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1696186909733.213160f7f7d3652e366f4b3f050cf2eb. after waiting 0 ms 2023-10-01 19:01:49,796 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1696186909733.213160f7f7d3652e366f4b3f050cf2eb. 2023-10-01 19:01:49,796 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1696186909733.213160f7f7d3652e366f4b3f050cf2eb. 2023-10-01 19:01:49,796 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 213160f7f7d3652e366f4b3f050cf2eb: 2023-10-01 19:01:49,799 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-10-01 19:01:49,800 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1696186909733.59dc6410fd5990fd1cdd946339c84185.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696186909800"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696186909800"}]},"ts":"1696186909800"} 2023-10-01 19:01:49,801 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1696186909733.213160f7f7d3652e366f4b3f050cf2eb.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696186909800"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696186909800"}]},"ts":"1696186909800"} 2023-10-01 19:01:49,803 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-01 19:01:49,804 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-01 19:01:49,804 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696186909804"}]},"ts":"1696186909804"} 2023-10-01 19:01:49,806 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-10-01 19:01:49,810 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-01 19:01:49,811 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-01 19:01:49,811 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-01 19:01:49,811 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-01 19:01:49,811 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-01 19:01:49,812 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=59dc6410fd5990fd1cdd946339c84185, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=213160f7f7d3652e366f4b3f050cf2eb, ASSIGN}] 2023-10-01 19:01:49,814 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=59dc6410fd5990fd1cdd946339c84185, ASSIGN 2023-10-01 19:01:49,814 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=213160f7f7d3652e366f4b3f050cf2eb, ASSIGN 2023-10-01 19:01:49,815 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=213160f7f7d3652e366f4b3f050cf2eb, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36507,1696186884612; forceNewPlan=false, retain=false 2023-10-01 19:01:49,815 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=59dc6410fd5990fd1cdd946339c84185, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46609,1696186884566; forceNewPlan=false, retain=false 2023-10-01 19:01:49,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-01 19:01:49,966 INFO [jenkins-hbase4:42819] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-01 19:01:49,969 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=213160f7f7d3652e366f4b3f050cf2eb, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:01:49,969 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=59dc6410fd5990fd1cdd946339c84185, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:01:49,969 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1696186909733.213160f7f7d3652e366f4b3f050cf2eb.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696186909969"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696186909969"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696186909969"}]},"ts":"1696186909969"} 2023-10-01 19:01:49,969 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1696186909733.59dc6410fd5990fd1cdd946339c84185.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696186909969"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696186909969"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696186909969"}]},"ts":"1696186909969"} 2023-10-01 19:01:49,971 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE; OpenRegionProcedure 213160f7f7d3652e366f4b3f050cf2eb, server=jenkins-hbase4.apache.org,36507,1696186884612}] 2023-10-01 19:01:49,973 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure 59dc6410fd5990fd1cdd946339c84185, server=jenkins-hbase4.apache.org,46609,1696186884566}] 2023-10-01 19:01:50,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-01 19:01:50,127 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:01:50,127 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-01 19:01:50,131 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59906, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-01 19:01:50,132 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1696186909733.213160f7f7d3652e366f4b3f050cf2eb. 2023-10-01 19:01:50,132 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 213160f7f7d3652e366f4b3f050cf2eb, NAME => 'testtb-testExportFileSystemState,1,1696186909733.213160f7f7d3652e366f4b3f050cf2eb.', STARTKEY => '1', ENDKEY => ''} 2023-10-01 19:01:50,133 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1696186909733.213160f7f7d3652e366f4b3f050cf2eb. service=AccessControlService 2023-10-01 19:01:50,134 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 19:01:50,135 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 213160f7f7d3652e366f4b3f050cf2eb 2023-10-01 19:01:50,135 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1696186909733.213160f7f7d3652e366f4b3f050cf2eb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 19:01:50,135 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 213160f7f7d3652e366f4b3f050cf2eb 2023-10-01 19:01:50,135 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 213160f7f7d3652e366f4b3f050cf2eb 2023-10-01 19:01:50,137 INFO [StoreOpener-213160f7f7d3652e366f4b3f050cf2eb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 213160f7f7d3652e366f4b3f050cf2eb 2023-10-01 19:01:50,138 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1696186909733.59dc6410fd5990fd1cdd946339c84185. 2023-10-01 19:01:50,138 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 59dc6410fd5990fd1cdd946339c84185, NAME => 'testtb-testExportFileSystemState,,1696186909733.59dc6410fd5990fd1cdd946339c84185.', STARTKEY => '', ENDKEY => '1'} 2023-10-01 19:01:50,139 DEBUG [StoreOpener-213160f7f7d3652e366f4b3f050cf2eb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemState/213160f7f7d3652e366f4b3f050cf2eb/cf 2023-10-01 19:01:50,139 DEBUG [StoreOpener-213160f7f7d3652e366f4b3f050cf2eb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemState/213160f7f7d3652e366f4b3f050cf2eb/cf 2023-10-01 19:01:50,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1696186909733.59dc6410fd5990fd1cdd946339c84185. service=AccessControlService 2023-10-01 19:01:50,139 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 19:01:50,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 59dc6410fd5990fd1cdd946339c84185 2023-10-01 19:01:50,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1696186909733.59dc6410fd5990fd1cdd946339c84185.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 19:01:50,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 59dc6410fd5990fd1cdd946339c84185 2023-10-01 19:01:50,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 59dc6410fd5990fd1cdd946339c84185 2023-10-01 19:01:50,139 INFO [StoreOpener-213160f7f7d3652e366f4b3f050cf2eb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 213160f7f7d3652e366f4b3f050cf2eb columnFamilyName cf 2023-10-01 19:01:50,140 INFO [StoreOpener-59dc6410fd5990fd1cdd946339c84185-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 59dc6410fd5990fd1cdd946339c84185 2023-10-01 19:01:50,141 INFO [StoreOpener-213160f7f7d3652e366f4b3f050cf2eb-1] regionserver.HStore(310): Store=213160f7f7d3652e366f4b3f050cf2eb/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 19:01:50,142 DEBUG [StoreOpener-59dc6410fd5990fd1cdd946339c84185-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemState/59dc6410fd5990fd1cdd946339c84185/cf 2023-10-01 19:01:50,142 DEBUG [StoreOpener-59dc6410fd5990fd1cdd946339c84185-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemState/59dc6410fd5990fd1cdd946339c84185/cf 2023-10-01 19:01:50,143 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemState/213160f7f7d3652e366f4b3f050cf2eb 2023-10-01 19:01:50,143 INFO [StoreOpener-59dc6410fd5990fd1cdd946339c84185-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 59dc6410fd5990fd1cdd946339c84185 columnFamilyName cf 2023-10-01 19:01:50,143 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemState/213160f7f7d3652e366f4b3f050cf2eb 2023-10-01 19:01:50,144 INFO [StoreOpener-59dc6410fd5990fd1cdd946339c84185-1] regionserver.HStore(310): Store=59dc6410fd5990fd1cdd946339c84185/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 19:01:50,146 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemState/59dc6410fd5990fd1cdd946339c84185 2023-10-01 19:01:50,146 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemState/59dc6410fd5990fd1cdd946339c84185 2023-10-01 19:01:50,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 213160f7f7d3652e366f4b3f050cf2eb 2023-10-01 19:01:50,149 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemState/213160f7f7d3652e366f4b3f050cf2eb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-01 19:01:50,150 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 59dc6410fd5990fd1cdd946339c84185 2023-10-01 19:01:50,150 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 213160f7f7d3652e366f4b3f050cf2eb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62956374, jitterRate=-0.061876922845840454}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-01 19:01:50,150 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 213160f7f7d3652e366f4b3f050cf2eb: 2023-10-01 19:01:50,151 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1696186909733.213160f7f7d3652e366f4b3f050cf2eb., pid=30, masterSystemTime=1696186910124 2023-10-01 19:01:50,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemState/59dc6410fd5990fd1cdd946339c84185/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-01 19:01:50,153 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 59dc6410fd5990fd1cdd946339c84185; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72359139, jitterRate=0.0782351940870285}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-01 19:01:50,153 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 59dc6410fd5990fd1cdd946339c84185: 2023-10-01 19:01:50,153 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1696186909733.213160f7f7d3652e366f4b3f050cf2eb. 2023-10-01 19:01:50,153 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1696186909733.213160f7f7d3652e366f4b3f050cf2eb. 2023-10-01 19:01:50,159 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1696186909733.59dc6410fd5990fd1cdd946339c84185., pid=31, masterSystemTime=1696186910127 2023-10-01 19:01:50,162 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=213160f7f7d3652e366f4b3f050cf2eb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:01:50,162 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1696186909733.213160f7f7d3652e366f4b3f050cf2eb.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696186910160"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696186910160"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696186910160"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696186910160"}]},"ts":"1696186910160"} 2023-10-01 19:01:50,164 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1696186909733.59dc6410fd5990fd1cdd946339c84185. 2023-10-01 19:01:50,165 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1696186909733.59dc6410fd5990fd1cdd946339c84185. 2023-10-01 19:01:50,166 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=59dc6410fd5990fd1cdd946339c84185, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:01:50,167 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1696186909733.59dc6410fd5990fd1cdd946339c84185.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696186910166"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696186910166"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696186910166"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696186910166"}]},"ts":"1696186910166"} 2023-10-01 19:01:50,169 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=30, resume processing ppid=29 2023-10-01 19:01:50,170 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=30, ppid=29, state=SUCCESS; OpenRegionProcedure 213160f7f7d3652e366f4b3f050cf2eb, server=jenkins-hbase4.apache.org,36507,1696186884612 in 194 msec 2023-10-01 19:01:50,171 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=213160f7f7d3652e366f4b3f050cf2eb, ASSIGN in 357 msec 2023-10-01 19:01:50,173 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=31, resume processing ppid=28 2023-10-01 19:01:50,173 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure 59dc6410fd5990fd1cdd946339c84185, server=jenkins-hbase4.apache.org,46609,1696186884566 in 198 msec 2023-10-01 19:01:50,176 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=28, resume processing ppid=27 2023-10-01 19:01:50,176 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=59dc6410fd5990fd1cdd946339c84185, ASSIGN in 361 msec 2023-10-01 19:01:50,177 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-01 19:01:50,177 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696186910177"}]},"ts":"1696186910177"} 2023-10-01 19:01:50,179 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-10-01 19:01:50,182 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-10-01 19:01:50,182 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-10-01 19:01:50,184 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36507] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-10-01 19:01:50,185 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 19:01:50,185 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 19:01:50,185 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 19:01:50,185 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 19:01:50,187 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-01 19:01:50,187 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-01 19:01:50,187 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-01 19:01:50,187 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-01 19:01:50,189 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 452 msec 2023-10-01 19:01:50,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-01 19:01:50,345 INFO [Listener at jenkins-hbase4.apache.org/36885] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-10-01 19:01:50,347 DEBUG [Listener at jenkins-hbase4.apache.org/36885] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-10-01 19:01:50,348 DEBUG [Listener at jenkins-hbase4.apache.org/36885] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1696186909733.59dc6410fd5990fd1cdd946339c84185. 2023-10-01 19:01:50,350 INFO [Listener at jenkins-hbase4.apache.org/36885] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-01 19:01:50,363 DEBUG [hconnection-0x6846c5bc-shared-pool-10] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 19:01:50,368 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59918, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 19:01:50,375 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-01 19:01:50,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696186910375 (current time:1696186910375). 2023-10-01 19:01:50,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-01 19:01:50,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(139): Connect 0x0ff037d0 to 127.0.0.1:55462 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 19:01:50,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@266aa122, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 19:01:50,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 19:01:50,394 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53594, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 19:01:50,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0ff037d0 to 127.0.0.1:55462 2023-10-01 19:01:50,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 19:01:50,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(139): Connect 0x5e186d9e to 127.0.0.1:55462 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 19:01:50,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@50d89f3a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 19:01:50,404 DEBUG [hconnection-0x234857b2-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 19:01:50,406 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53598, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 19:01:50,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 19:01:50,412 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46956, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 19:01:50,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5e186d9e to 127.0.0.1:55462 2023-10-01 19:01:50,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 19:01:50,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-10-01 19:01:50,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-01 19:01:50,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-01 19:01:50,419 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot, current working dir path: hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-01 19:01:50,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] procedure2.ProcedureExecutor(1028): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-01 19:01:50,423 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-01 19:01:50,424 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1696187510424 2023-10-01 19:01:50,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-01 19:01:50,425 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-10-01 19:01:50,426 DEBUG [Listener at jenkins-hbase4.apache.org/36885] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-01 19:01:50,426 DEBUG [Listener at jenkins-hbase4.apache.org/36885] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-01 19:01:50,428 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-01 19:01:50,428 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-01 19:01:50,429 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 8 msec 2023-10-01 19:01:50,430 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-01 19:01:50,431 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1696187510431 2023-10-01 19:01:50,448 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-10-01 19:01:50,448 INFO [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-10-01 19:01:50,448 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 19:01:50,450 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-10-01 19:01:50,450 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-10-01 19:01:50,450 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-01 19:01:50,450 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-01 19:01:50,453 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 19:01:50,453 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 19:01:50,453 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 19:01:50,453 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 19:01:50,453 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:01:50,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 19:01:50,453 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 19:01:50,453 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 19:01:50,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 19:01:50,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 19:01:50,453 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:01:50,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-01 19:01:50,454 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:01:50,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-01 19:01:50,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-01 19:01:50,454 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-01 19:01:50,454 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-01 19:01:50,455 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-01 19:01:50,455 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:01:50,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-10-01 19:01:50,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-01 19:01:50,456 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-01 19:01:50,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-10-01 19:01:50,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-01 19:01:50,456 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-01 19:01:50,456 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-01 19:01:50,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-10-01 19:01:50,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-01 19:01:50,456 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-10-01 19:01:50,456 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-10-01 19:01:50,456 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-01 19:01:50,456 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-01 19:01:50,456 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 19:01:50,456 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-01 19:01:50,458 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-01 19:01:50,456 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 19:01:50,458 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-10-01 19:01:50,458 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36507,1696186884612' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-10-01 19:01:50,459 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-01 19:01:50,459 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-10-01 19:01:50,459 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-10-01 19:01:50,459 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-01 19:01:50,459 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 19:01:50,459 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46609,1696186884566' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-10-01 19:01:50,460 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-01 19:01:50,460 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-10-01 19:01:50,460 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44933,1696186884649' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-10-01 19:01:50,462 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:01:50,462 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-01 19:01:50,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:01:50,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 19:01:50,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 19:01:50,472 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-01 19:01:50,472 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-01 19:01:50,472 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 19:01:50,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 19:01:50,473 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-01 19:01:50,473 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 19:01:50,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 19:01:50,473 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:01:50,473 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-01 19:01:50,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-01 19:01:50,473 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-01 19:01:50,474 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 19:01:50,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:01:50,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:01:50,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:01:50,474 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-10-01 19:01:50,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 19:01:50,475 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36507,1696186884612' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-10-01 19:01:50,475 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2d3f1d33[Count = 1] remaining members to acquire global barrier 2023-10-01 19:01:50,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:01:50,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 19:01:50,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 19:01:50,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 19:01:50,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 19:01:50,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-01 19:01:50,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:01:50,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:01:50,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:01:50,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 19:01:50,477 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46609,1696186884566' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-10-01 19:01:50,477 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2d3f1d33[Count = 0] remaining members to acquire global barrier 2023-10-01 19:01:50,477 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-10-01 19:01:50,478 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-01 19:01:50,479 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-01 19:01:50,479 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-01 19:01:50,479 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-01 19:01:50,479 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-01 19:01:50,479 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-01 19:01:50,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-01 19:01:50,479 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-01 19:01:50,479 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-01 19:01:50,479 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:01:50,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-01 19:01:50,479 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-10-01 19:01:50,479 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-01 19:01:50,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-01 19:01:50,479 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44933,1696186884649' in zk 2023-10-01 19:01:50,479 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-01 19:01:50,479 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 19:01:50,479 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 19:01:50,479 DEBUG [rs(jenkins-hbase4.apache.org,46609,1696186884566)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1696186909733.59dc6410fd5990fd1cdd946339c84185. 2023-10-01 19:01:50,479 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 19:01:50,480 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 19:01:50,480 DEBUG [rs(jenkins-hbase4.apache.org,46609,1696186884566)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1696186909733.59dc6410fd5990fd1cdd946339c84185. started... 2023-10-01 19:01:50,480 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1696186909733.213160f7f7d3652e366f4b3f050cf2eb. 2023-10-01 19:01:50,480 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:01:50,480 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-01 19:01:50,480 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1696186909733.213160f7f7d3652e366f4b3f050cf2eb. started... 2023-10-01 19:01:50,480 DEBUG [rs(jenkins-hbase4.apache.org,46609,1696186884566)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 59dc6410fd5990fd1cdd946339c84185: 2023-10-01 19:01:50,481 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 213160f7f7d3652e366f4b3f050cf2eb: 2023-10-01 19:01:50,482 DEBUG [rs(jenkins-hbase4.apache.org,46609,1696186884566)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1696186909733.59dc6410fd5990fd1cdd946339c84185.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-10-01 19:01:50,482 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-10-01 19:01:50,482 DEBUG [rs(jenkins-hbase4.apache.org,46609,1696186884566)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 19:01:50,482 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 19:01:50,482 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1696186909733.213160f7f7d3652e366f4b3f050cf2eb.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-10-01 19:01:50,482 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-10-01 19:01:50,482 DEBUG [rs(jenkins-hbase4.apache.org,46609,1696186884566)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-01 19:01:50,483 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 19:01:50,483 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-01 19:01:50,503 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1696186909733.213160f7f7d3652e366f4b3f050cf2eb. completed. 2023-10-01 19:01:50,503 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1696186909733.213160f7f7d3652e366f4b3f050cf2eb. 2023-10-01 19:01:50,503 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 19:01:50,503 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 19:01:50,504 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:01:50,504 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-10-01 19:01:50,504 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,36507,1696186884612' in zk 2023-10-01 19:01:50,506 DEBUG [rs(jenkins-hbase4.apache.org,46609,1696186884566)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1696186909733.59dc6410fd5990fd1cdd946339c84185. completed. 2023-10-01 19:01:50,506 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-10-01 19:01:50,506 DEBUG [rs(jenkins-hbase4.apache.org,46609,1696186884566)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1696186909733.59dc6410fd5990fd1cdd946339c84185. 2023-10-01 19:01:50,506 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:01:50,507 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 19:01:50,507 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 19:01:50,507 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:01:50,507 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 19:01:50,507 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-10-01 19:01:50,507 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-10-01 19:01:50,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:01:50,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 19:01:50,507 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,46609,1696186884566' in zk 2023-10-01 19:01:50,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 19:01:50,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 19:01:50,510 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:01:50,510 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-10-01 19:01:50,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 19:01:50,510 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 19:01:50,510 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-10-01 19:01:50,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-01 19:01:50,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:01:50,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:01:50,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:01:50,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 19:01:50,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-01 19:01:50,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:01:50,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:01:50,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:01:50,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,36507,1696186884612': 2023-10-01 19:01:50,514 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36507,1696186884612' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-10-01 19:01:50,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:01:50,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 19:01:50,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 19:01:50,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 19:01:50,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 19:01:50,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-01 19:01:50,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:01:50,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:01:50,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:01:50,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 19:01:50,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-01 19:01:50,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:01:50,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:01:50,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:01:50,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,46609,1696186884566': 2023-10-01 19:01:50,518 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46609,1696186884566' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-10-01 19:01:50,518 INFO [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-10-01 19:01:50,518 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-01 19:01:50,518 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-01 19:01:50,518 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-10-01 19:01:50,518 INFO [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-01 19:01:50,520 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-01 19:01:50,520 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-01 19:01:50,520 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-01 19:01:50,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-01 19:01:50,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 19:01:50,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 19:01:50,520 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 19:01:50,520 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-01 19:01:50,520 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-01 19:01:50,520 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 19:01:50,520 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-01 19:01:50,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-01 19:01:50,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-01 19:01:50,520 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 19:01:50,520 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-01 19:01:50,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-01 19:01:50,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 19:01:50,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 19:01:50,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 19:01:50,521 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:01:50,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 19:01:50,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 19:01:50,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 19:01:50,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 19:01:50,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-01 19:01:50,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-01 19:01:50,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-01 19:01:50,522 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:01:50,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-01 19:01:50,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 19:01:50,522 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:01:50,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-01 19:01:50,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:01:50,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:01:50,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:01:50,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 19:01:50,524 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:01:50,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-01 19:01:50,525 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:01:50,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:01:50,525 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:01:50,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:01:50,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:01:50,526 DEBUG [Listener at jenkins-hbase4.apache.org/36885] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 19:01:50,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-01 19:01:50,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-01 19:01:50,528 DEBUG [Listener at jenkins-hbase4.apache.org/36885] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-01 19:01:50,529 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:01:50,529 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 19:01:50,529 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 19:01:50,529 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 19:01:50,529 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 19:01:50,529 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 19:01:50,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 19:01:50,529 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-10-01 19:01:50,529 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 19:01:50,529 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 19:01:50,529 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 19:01:50,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 19:01:50,529 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-01 19:01:50,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 19:01:50,529 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 19:01:50,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 19:01:50,529 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-10-01 19:01:50,530 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-10-01 19:01:50,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 19:01:50,529 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 19:01:50,529 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 19:01:50,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 19:01:50,531 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 19:01:50,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 19:01:50,530 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-01 19:01:50,529 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:01:50,531 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:01:50,531 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-01 19:01:50,531 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:01:50,531 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-01 19:01:50,532 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:01:50,532 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:01:50,532 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-01 19:01:50,532 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-01 19:01:50,532 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-01 19:01:50,549 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-10-01 19:01:50,550 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-10-01 19:01:50,577 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-10-01 19:01:50,577 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-10-01 19:01:50,577 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-10-01 19:01:50,578 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-10-01 19:01:50,578 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1696186910425Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1696186910549 (+124 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1696186910549Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1696186910549Writing data manifest for emptySnaptb0-testExportFileSystemState at 1696186910554 (+5 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1696186910570 (+16 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1696186910577 (+7 ms) 2023-10-01 19:01:50,580 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-01 19:01:50,582 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 154 msec 2023-10-01 19:01:50,728 DEBUG [Listener at jenkins-hbase4.apache.org/36885] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 19:01:50,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-01 19:01:50,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-01 19:01:50,738 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46609] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1696186909733.59dc6410fd5990fd1cdd946339c84185. with WAL disabled. Data may be lost in the event of a crash. 2023-10-01 19:01:50,740 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36507] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1696186909733.213160f7f7d3652e366f4b3f050cf2eb. with WAL disabled. Data may be lost in the event of a crash. 2023-10-01 19:01:50,745 DEBUG [Listener at jenkins-hbase4.apache.org/36885] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-10-01 19:01:50,745 DEBUG [Listener at jenkins-hbase4.apache.org/36885] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1696186909733.59dc6410fd5990fd1cdd946339c84185. 2023-10-01 19:01:50,745 INFO [Listener at jenkins-hbase4.apache.org/36885] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-01 19:01:50,759 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-01 19:01:50,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696186910759 (current time:1696186910759). 2023-10-01 19:01:50,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-01 19:01:50,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(139): Connect 0x31b17d2d to 127.0.0.1:55462 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 19:01:50,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4a09fea8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 19:01:50,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 19:01:50,770 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53612, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 19:01:50,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x31b17d2d to 127.0.0.1:55462 2023-10-01 19:01:50,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 19:01:50,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(139): Connect 0x5b7683b5 to 127.0.0.1:55462 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 19:01:50,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@646d8bd7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 19:01:50,780 DEBUG [hconnection-0x23f99adb-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 19:01:50,783 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53620, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 19:01:50,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 19:01:50,789 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46960, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 19:01:50,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5b7683b5 to 127.0.0.1:55462 2023-10-01 19:01:50,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 19:01:50,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-10-01 19:01:50,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-01 19:01:50,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-01 19:01:50,795 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot, current working dir path: hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-01 19:01:50,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] procedure2.ProcedureExecutor(1028): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-01 19:01:50,798 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-01 19:01:50,800 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1696187510800 2023-10-01 19:01:50,800 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-10-01 19:01:50,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-01 19:01:50,803 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-01 19:01:50,803 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-01 19:01:50,803 DEBUG [Listener at jenkins-hbase4.apache.org/36885] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-01 19:01:50,803 DEBUG [Listener at jenkins-hbase4.apache.org/36885] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-01 19:01:50,805 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 8 msec 2023-10-01 19:01:50,806 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-01 19:01:50,808 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1696187510808 2023-10-01 19:01:50,819 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-10-01 19:01:50,819 INFO [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-10-01 19:01:50,819 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 19:01:50,821 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-10-01 19:01:50,821 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-10-01 19:01:50,821 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-01 19:01:50,821 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-01 19:01:50,823 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 19:01:50,823 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 19:01:50,823 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 19:01:50,823 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 19:01:50,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 19:01:50,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 19:01:50,823 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 19:01:50,823 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:01:50,824 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 19:01:50,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 19:01:50,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-01 19:01:50,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-01 19:01:50,824 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:01:50,824 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:01:50,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-01 19:01:50,824 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-01 19:01:50,824 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-01 19:01:50,825 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:01:50,825 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-01 19:01:50,824 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-01 19:01:50,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-10-01 19:01:50,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-01 19:01:50,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-10-01 19:01:50,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-01 19:01:50,825 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-01 19:01:50,825 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-01 19:01:50,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-10-01 19:01:50,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-01 19:01:50,825 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-01 19:01:50,826 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-10-01 19:01:50,826 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-10-01 19:01:50,826 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-01 19:01:50,826 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-01 19:01:50,826 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-10-01 19:01:50,826 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 19:01:50,826 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-01 19:01:50,827 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 19:01:50,826 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 19:01:50,827 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-01 19:01:50,828 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-01 19:01:50,829 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-10-01 19:01:50,830 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-10-01 19:01:50,830 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46609,1696186884566' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-10-01 19:01:50,829 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-01 19:01:50,830 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44933,1696186884649' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-10-01 19:01:50,830 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-10-01 19:01:50,830 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36507,1696186884612' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-10-01 19:01:50,831 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-01 19:01:50,831 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:01:50,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:01:50,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 19:01:50,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 19:01:50,832 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-01 19:01:50,832 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:01:50,832 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-01 19:01:50,832 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-01 19:01:50,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 19:01:50,833 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 19:01:50,833 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-01 19:01:50,833 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 19:01:50,833 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-01 19:01:50,833 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 19:01:50,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 19:01:50,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-01 19:01:50,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:01:50,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:01:50,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:01:50,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 19:01:50,835 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46609,1696186884566' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-10-01 19:01:50,835 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@66b304c1[Count = 1] remaining members to acquire global barrier 2023-10-01 19:01:50,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:01:50,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 19:01:50,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 19:01:50,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 19:01:50,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 19:01:50,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-01 19:01:50,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:01:50,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:01:50,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:01:50,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 19:01:50,837 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36507,1696186884612' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-10-01 19:01:50,837 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@66b304c1[Count = 0] remaining members to acquire global barrier 2023-10-01 19:01:50,837 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-10-01 19:01:50,838 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-01 19:01:50,839 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-01 19:01:50,839 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-01 19:01:50,839 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-01 19:01:50,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-01 19:01:50,839 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-01 19:01:50,839 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-01 19:01:50,839 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-01 19:01:50,839 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:01:50,839 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-01 19:01:50,839 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 19:01:50,839 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 19:01:50,839 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1696186909733.213160f7f7d3652e366f4b3f050cf2eb. 2023-10-01 19:01:50,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-01 19:01:50,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-01 19:01:50,840 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-01 19:01:50,840 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-01 19:01:50,840 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-10-01 19:01:50,840 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:01:50,840 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-01 19:01:50,840 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1696186909733.213160f7f7d3652e366f4b3f050cf2eb. started... 2023-10-01 19:01:50,840 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 19:01:50,840 DEBUG [rs(jenkins-hbase4.apache.org,46609,1696186884566)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1696186909733.59dc6410fd5990fd1cdd946339c84185. 2023-10-01 19:01:50,840 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 19:01:50,840 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44933,1696186884649' in zk 2023-10-01 19:01:50,840 INFO [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 213160f7f7d3652e366f4b3f050cf2eb 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-10-01 19:01:50,840 DEBUG [rs(jenkins-hbase4.apache.org,46609,1696186884566)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1696186909733.59dc6410fd5990fd1cdd946339c84185. started... 2023-10-01 19:01:50,840 INFO [rs(jenkins-hbase4.apache.org,46609,1696186884566)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 59dc6410fd5990fd1cdd946339c84185 1/1 column families, dataSize=199 B heapSize=688 B 2023-10-01 19:01:50,843 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-10-01 19:01:50,843 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 19:01:50,843 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-10-01 19:01:50,903 DEBUG [Listener at jenkins-hbase4.apache.org/36885] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 19:01:50,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-01 19:01:50,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-01 19:01:50,905 DEBUG [Listener at jenkins-hbase4.apache.org/36885] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-01 19:01:51,105 DEBUG [Listener at jenkins-hbase4.apache.org/36885] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 19:01:51,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-01 19:01:51,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-01 19:01:51,107 DEBUG [Listener at jenkins-hbase4.apache.org/36885] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-10-01 19:01:51,288 INFO [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231001d777b401f68e4592a8a5bd2e24e50e21 to hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20231001d777b401f68e4592a8a5bd2e24e50e21 2023-10-01 19:01:51,289 INFO [rs(jenkins-hbase4.apache.org,46609,1696186884566)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310011c024973446c46709e31e05b99ef5410 to hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202310011c024973446c46709e31e05b99ef5410 2023-10-01 19:01:51,300 INFO [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemState/213160f7f7d3652e366f4b3f050cf2eb/.tmp/cf/83a3f91d08404b2999394412f95a1991 2023-10-01 19:01:51,300 INFO [rs(jenkins-hbase4.apache.org,46609,1696186884566)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemState/59dc6410fd5990fd1cdd946339c84185/.tmp/cf/4434bfe789c4436fa4925b3eaef8453e 2023-10-01 19:01:51,306 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemState/213160f7f7d3652e366f4b3f050cf2eb/.tmp/cf/83a3f91d08404b2999394412f95a1991 as hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemState/213160f7f7d3652e366f4b3f050cf2eb/cf/83a3f91d08404b2999394412f95a1991 2023-10-01 19:01:51,306 DEBUG [rs(jenkins-hbase4.apache.org,46609,1696186884566)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemState/59dc6410fd5990fd1cdd946339c84185/.tmp/cf/4434bfe789c4436fa4925b3eaef8453e as hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemState/59dc6410fd5990fd1cdd946339c84185/cf/4434bfe789c4436fa4925b3eaef8453e 2023-10-01 19:01:51,311 INFO [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemState/213160f7f7d3652e366f4b3f050cf2eb/cf/83a3f91d08404b2999394412f95a1991, entries=47, sequenceid=6, filesize=12.8 K 2023-10-01 19:01:51,311 INFO [rs(jenkins-hbase4.apache.org,46609,1696186884566)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemState/59dc6410fd5990fd1cdd946339c84185/cf/4434bfe789c4436fa4925b3eaef8453e, entries=3, sequenceid=6, filesize=5.4 K 2023-10-01 19:01:51,312 INFO [rs(jenkins-hbase4.apache.org,46609,1696186884566)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 59dc6410fd5990fd1cdd946339c84185 in 472ms, sequenceid=6, compaction requested=false 2023-10-01 19:01:51,312 INFO [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 213160f7f7d3652e366f4b3f050cf2eb in 472ms, sequenceid=6, compaction requested=false 2023-10-01 19:01:51,314 DEBUG [rs(jenkins-hbase4.apache.org,46609,1696186884566)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 59dc6410fd5990fd1cdd946339c84185: 2023-10-01 19:01:51,314 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 213160f7f7d3652e366f4b3f050cf2eb: 2023-10-01 19:01:51,314 DEBUG [rs(jenkins-hbase4.apache.org,46609,1696186884566)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1696186909733.59dc6410fd5990fd1cdd946339c84185.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-10-01 19:01:51,314 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1696186909733.213160f7f7d3652e366f4b3f050cf2eb.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-10-01 19:01:51,314 DEBUG [rs(jenkins-hbase4.apache.org,46609,1696186884566)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 19:01:51,314 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 19:01:51,314 DEBUG [rs(jenkins-hbase4.apache.org,46609,1696186884566)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemState/59dc6410fd5990fd1cdd946339c84185/cf/4434bfe789c4436fa4925b3eaef8453e] hfiles 2023-10-01 19:01:51,314 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemState/213160f7f7d3652e366f4b3f050cf2eb/cf/83a3f91d08404b2999394412f95a1991] hfiles 2023-10-01 19:01:51,314 DEBUG [rs(jenkins-hbase4.apache.org,46609,1696186884566)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemState/59dc6410fd5990fd1cdd946339c84185/cf/4434bfe789c4436fa4925b3eaef8453e for snapshot=snaptb0-testExportFileSystemState 2023-10-01 19:01:51,314 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemState/213160f7f7d3652e366f4b3f050cf2eb/cf/83a3f91d08404b2999394412f95a1991 for snapshot=snaptb0-testExportFileSystemState 2023-10-01 19:01:51,328 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1696186909733.213160f7f7d3652e366f4b3f050cf2eb. completed. 2023-10-01 19:01:51,328 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1696186909733.213160f7f7d3652e366f4b3f050cf2eb. 2023-10-01 19:01:51,328 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 19:01:51,328 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 19:01:51,328 DEBUG [rs(jenkins-hbase4.apache.org,46609,1696186884566)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1696186909733.59dc6410fd5990fd1cdd946339c84185. completed. 2023-10-01 19:01:51,328 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:01:51,328 DEBUG [rs(jenkins-hbase4.apache.org,46609,1696186884566)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1696186909733.59dc6410fd5990fd1cdd946339c84185. 2023-10-01 19:01:51,328 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-10-01 19:01:51,328 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,36507,1696186884612' in zk 2023-10-01 19:01:51,328 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 19:01:51,328 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 19:01:51,328 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:01:51,328 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-10-01 19:01:51,328 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,46609,1696186884566' in zk 2023-10-01 19:01:51,333 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-10-01 19:01:51,333 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-10-01 19:01:51,333 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 19:01:51,333 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:01:51,333 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-10-01 19:01:51,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:01:51,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 19:01:51,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 19:01:51,333 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 19:01:51,334 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:01:51,335 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-10-01 19:01:51,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 19:01:51,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 19:01:51,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-01 19:01:51,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:01:51,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:01:51,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:01:51,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 19:01:51,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-01 19:01:51,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:01:51,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:01:51,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:01:51,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,36507,1696186884612': 2023-10-01 19:01:51,340 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36507,1696186884612' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-10-01 19:01:51,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:01:51,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 19:01:51,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 19:01:51,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 19:01:51,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 19:01:51,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-01 19:01:51,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:01:51,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:01:51,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:01:51,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 19:01:51,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-01 19:01:51,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:01:51,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:01:51,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:01:51,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,46609,1696186884566': 2023-10-01 19:01:51,343 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46609,1696186884566' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-10-01 19:01:51,343 INFO [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-10-01 19:01:51,343 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-01 19:01:51,343 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-01 19:01:51,343 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-10-01 19:01:51,343 INFO [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-01 19:01:51,345 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-01 19:01:51,345 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-01 19:01:51,345 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-01 19:01:51,345 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-01 19:01:51,345 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-01 19:01:51,345 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-01 19:01:51,345 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 19:01:51,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-01 19:01:51,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 19:01:51,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 19:01:51,345 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-01 19:01:51,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-01 19:01:51,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-01 19:01:51,345 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 19:01:51,345 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 19:01:51,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-01 19:01:51,346 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 19:01:51,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 19:01:51,346 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 19:01:51,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 19:01:51,346 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:01:51,346 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 19:01:51,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 19:01:51,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 19:01:51,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-01 19:01:51,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-01 19:01:51,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-01 19:01:51,347 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:01:51,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-01 19:01:51,347 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:01:51,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 19:01:51,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-01 19:01:51,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:01:51,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:01:51,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:01:51,349 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:01:51,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 19:01:51,349 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:01:51,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-01 19:01:51,349 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:01:51,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:01:51,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:01:51,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:01:51,354 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:01:51,354 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-01 19:01:51,354 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:01:51,354 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:01:51,354 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 19:01:51,354 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 19:01:51,354 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 19:01:51,354 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 19:01:51,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 19:01:51,354 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-01 19:01:51,354 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 19:01:51,354 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 19:01:51,354 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 19:01:51,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 19:01:51,354 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 19:01:51,354 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 19:01:51,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 19:01:51,354 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 19:01:51,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 19:01:51,354 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-10-01 19:01:51,354 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 19:01:51,354 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:01:51,356 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 19:01:51,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 19:01:51,355 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 19:01:51,355 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-10-01 19:01:51,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 19:01:51,356 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-01 19:01:51,356 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-10-01 19:01:51,356 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:01:51,357 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-01 19:01:51,357 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:01:51,357 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-01 19:01:51,357 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-01 19:01:51,358 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20231001d777b401f68e4592a8a5bd2e24e50e21, hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202310011c024973446c46709e31e05b99ef5410] mob files 2023-10-01 19:01:51,358 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20231001d777b401f68e4592a8a5bd2e24e50e21 2023-10-01 19:01:51,358 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202310011c024973446c46709e31e05b99ef5410 2023-10-01 19:01:51,369 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-10-01 19:01:51,370 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-01 19:01:51,391 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-10-01 19:01:51,392 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-10-01 19:01:51,392 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-01 19:01:51,392 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-01 19:01:51,392 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1696186910800Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1696186911369 (+569 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1696186911369Loading Region manifests for snaptb0-testExportFileSystemState at 1696186911369Writing data manifest for snaptb0-testExportFileSystemState at 1696186911373 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1696186911383 (+10 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1696186911392 (+9 ms) 2023-10-01 19:01:51,395 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-01 19:01:51,397 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 594 msec 2023-10-01 19:01:51,407 DEBUG [Listener at jenkins-hbase4.apache.org/36885] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 19:01:51,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-01 19:01:51,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-01 19:01:51,408 INFO [Listener at jenkins-hbase4.apache.org/36885] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/export-test/export-1696186911408 2023-10-01 19:01:51,409 INFO [Listener at jenkins-hbase4.apache.org/36885] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:38933, tgtDir=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/export-test/export-1696186911408, rawTgtDir=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/export-test/export-1696186911408, srcFsUri=hdfs://localhost:38933, srcDir=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399 2023-10-01 19:01:51,433 DEBUG [Listener at jenkins-hbase4.apache.org/36885] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:38933, inputRoot=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399 2023-10-01 19:01:51,433 DEBUG [Listener at jenkins-hbase4.apache.org/36885] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2016181706_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/export-test/export-1696186911408, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/export-test/export-1696186911408/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-01 19:01:51,433 INFO [Listener at jenkins-hbase4.apache.org/36885] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:38933, inputRoot=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399, snapshotDir=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-10-01 19:01:51,449 INFO [Listener at jenkins-hbase4.apache.org/36885] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/export-test/export-1696186911408/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-01 19:01:51,472 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-01 19:01:51,473 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-01 19:01:51,474 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-01 19:01:51,474 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-01 19:01:52,365 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba/hadoop-1365267316552154004.jar 2023-10-01 19:01:52,365 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-01 19:01:52,366 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-01 19:01:52,433 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba/hadoop-5992085265308582995.jar 2023-10-01 19:01:52,433 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-01 19:01:52,434 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-01 19:01:52,434 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-01 19:01:52,434 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-01 19:01:52,435 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-01 19:01:52,435 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-01 19:01:52,435 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-01 19:01:52,436 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-01 19:01:52,436 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-01 19:01:52,437 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-01 19:01:52,437 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-01 19:01:52,437 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-01 19:01:52,438 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-01 19:01:52,438 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-01 19:01:52,438 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-01 19:01:52,439 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-01 19:01:52,440 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 19:01:52,440 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 19:01:52,441 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 19:01:52,441 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 19:01:52,441 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 19:01:52,442 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 19:01:52,442 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 19:01:52,882 WARN [Listener at jenkins-hbase4.apache.org/36885] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-01 19:01:52,886 INFO [Listener at jenkins-hbase4.apache.org/36885] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-10-01 19:01:52,889 DEBUG [Listener at jenkins-hbase4.apache.org/36885] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-10-01 19:01:53,433 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-01 19:01:53,433 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-01 19:01:53,440 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696186890860_0001_000001 (auth:SIMPLE) 2023-10-01 19:01:54,191 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696186890860_0002_000001 (auth:SIMPLE) 2023-10-01 19:01:55,032 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-01 19:01:58,327 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696186890860_0002_000001 (auth:SIMPLE) 2023-10-01 19:02:00,573 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696186890860_0002_000001 (auth:SIMPLE) 2023-10-01 19:02:03,812 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696186890860_0002_000001 (auth:SIMPLE) 2023-10-01 19:02:05,081 INFO [Listener at jenkins-hbase4.apache.org/36885] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-01 19:02:05,082 INFO [Listener at jenkins-hbase4.apache.org/36885] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-01 19:02:05,090 INFO [Listener at jenkins-hbase4.apache.org/36885] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-10-01 19:02:05,090 INFO [Listener at jenkins-hbase4.apache.org/36885] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-01 19:02:05,090 INFO [Listener at jenkins-hbase4.apache.org/36885] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-01 19:02:05,091 DEBUG [Listener at jenkins-hbase4.apache.org/36885] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-628947520_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-10-01 19:02:05,091 DEBUG [Listener at jenkins-hbase4.apache.org/36885] snapshot.TestExportSnapshot(367): hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-10-01 19:02:05,091 DEBUG [Listener at jenkins-hbase4.apache.org/36885] snapshot.TestExportSnapshot(367): hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-10-01 19:02:05,091 DEBUG [Listener at jenkins-hbase4.apache.org/36885] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-628947520_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/export-test/export-1696186911408/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/export-test/export-1696186911408/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-10-01 19:02:05,092 DEBUG [Listener at jenkins-hbase4.apache.org/36885] snapshot.TestExportSnapshot(367): hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/export-test/export-1696186911408/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-10-01 19:02:05,092 DEBUG [Listener at jenkins-hbase4.apache.org/36885] snapshot.TestExportSnapshot(367): hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/export-test/export-1696186911408/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-10-01 19:02:05,099 INFO [Listener at jenkins-hbase4.apache.org/36885] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-10-01 19:02:05,100 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-10-01 19:02:05,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] procedure2.ProcedureExecutor(1028): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-10-01 19:02:05,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-10-01 19:02:05,106 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696186925106"}]},"ts":"1696186925106"} 2023-10-01 19:02:05,108 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-10-01 19:02:05,110 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-10-01 19:02:05,111 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=59dc6410fd5990fd1cdd946339c84185, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=213160f7f7d3652e366f4b3f050cf2eb, UNASSIGN}] 2023-10-01 19:02:05,114 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=59dc6410fd5990fd1cdd946339c84185, UNASSIGN 2023-10-01 19:02:05,114 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=213160f7f7d3652e366f4b3f050cf2eb, UNASSIGN 2023-10-01 19:02:05,115 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=59dc6410fd5990fd1cdd946339c84185, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:05,115 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=213160f7f7d3652e366f4b3f050cf2eb, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:05,115 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1696186909733.59dc6410fd5990fd1cdd946339c84185.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696186925115"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696186925115"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696186925115"}]},"ts":"1696186925115"} 2023-10-01 19:02:05,115 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1696186909733.213160f7f7d3652e366f4b3f050cf2eb.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696186925115"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696186925115"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696186925115"}]},"ts":"1696186925115"} 2023-10-01 19:02:05,117 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure 59dc6410fd5990fd1cdd946339c84185, server=jenkins-hbase4.apache.org,46609,1696186884566}] 2023-10-01 19:02:05,118 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure 213160f7f7d3652e366f4b3f050cf2eb, server=jenkins-hbase4.apache.org,36507,1696186884612}] 2023-10-01 19:02:05,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-10-01 19:02:05,270 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 59dc6410fd5990fd1cdd946339c84185 2023-10-01 19:02:05,271 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 59dc6410fd5990fd1cdd946339c84185, disabling compactions & flushes 2023-10-01 19:02:05,271 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1696186909733.59dc6410fd5990fd1cdd946339c84185. 2023-10-01 19:02:05,271 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1696186909733.59dc6410fd5990fd1cdd946339c84185. 2023-10-01 19:02:05,271 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1696186909733.59dc6410fd5990fd1cdd946339c84185. after waiting 0 ms 2023-10-01 19:02:05,271 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1696186909733.59dc6410fd5990fd1cdd946339c84185. 2023-10-01 19:02:05,271 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 213160f7f7d3652e366f4b3f050cf2eb 2023-10-01 19:02:05,271 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 213160f7f7d3652e366f4b3f050cf2eb, disabling compactions & flushes 2023-10-01 19:02:05,271 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1696186909733.213160f7f7d3652e366f4b3f050cf2eb. 2023-10-01 19:02:05,274 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1696186909733.213160f7f7d3652e366f4b3f050cf2eb. 2023-10-01 19:02:05,275 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1696186909733.213160f7f7d3652e366f4b3f050cf2eb. after waiting 0 ms 2023-10-01 19:02:05,275 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1696186909733.213160f7f7d3652e366f4b3f050cf2eb. 2023-10-01 19:02:05,280 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemState/59dc6410fd5990fd1cdd946339c84185/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-01 19:02:05,281 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemState/213160f7f7d3652e366f4b3f050cf2eb/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-01 19:02:05,281 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 19:02:05,281 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 19:02:05,282 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1696186909733.59dc6410fd5990fd1cdd946339c84185. 2023-10-01 19:02:05,283 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1696186909733.213160f7f7d3652e366f4b3f050cf2eb. 2023-10-01 19:02:05,283 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 59dc6410fd5990fd1cdd946339c84185: 2023-10-01 19:02:05,283 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 213160f7f7d3652e366f4b3f050cf2eb: 2023-10-01 19:02:05,285 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 59dc6410fd5990fd1cdd946339c84185 2023-10-01 19:02:05,285 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=59dc6410fd5990fd1cdd946339c84185, regionState=CLOSED 2023-10-01 19:02:05,286 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1696186909733.59dc6410fd5990fd1cdd946339c84185.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696186925285"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696186925285"}]},"ts":"1696186925285"} 2023-10-01 19:02:05,286 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 213160f7f7d3652e366f4b3f050cf2eb 2023-10-01 19:02:05,286 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=213160f7f7d3652e366f4b3f050cf2eb, regionState=CLOSED 2023-10-01 19:02:05,286 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1696186909733.213160f7f7d3652e366f4b3f050cf2eb.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696186925286"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696186925286"}]},"ts":"1696186925286"} 2023-10-01 19:02:05,290 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=39, resume processing ppid=37 2023-10-01 19:02:05,290 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure 59dc6410fd5990fd1cdd946339c84185, server=jenkins-hbase4.apache.org,46609,1696186884566 in 170 msec 2023-10-01 19:02:05,291 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=40, resume processing ppid=38 2023-10-01 19:02:05,291 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure 213160f7f7d3652e366f4b3f050cf2eb, server=jenkins-hbase4.apache.org,36507,1696186884612 in 170 msec 2023-10-01 19:02:05,292 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=59dc6410fd5990fd1cdd946339c84185, UNASSIGN in 179 msec 2023-10-01 19:02:05,293 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=38, resume processing ppid=36 2023-10-01 19:02:05,293 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=213160f7f7d3652e366f4b3f050cf2eb, UNASSIGN in 180 msec 2023-10-01 19:02:05,294 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696186925294"}]},"ts":"1696186925294"} 2023-10-01 19:02:05,295 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-10-01 19:02:05,297 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-10-01 19:02:05,299 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 198 msec 2023-10-01 19:02:05,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-10-01 19:02:05,408 INFO [Listener at jenkins-hbase4.apache.org/36885] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-10-01 19:02:05,409 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-10-01 19:02:05,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] procedure2.ProcedureExecutor(1028): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-01 19:02:05,413 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-01 19:02:05,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-10-01 19:02:05,414 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-01 19:02:05,415 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36507] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-10-01 19:02:05,419 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportFileSystemState/59dc6410fd5990fd1cdd946339c84185 2023-10-01 19:02:05,419 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportFileSystemState/213160f7f7d3652e366f4b3f050cf2eb 2023-10-01 19:02:05,419 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-01 19:02:05,419 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-01 19:02:05,419 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-01 19:02:05,419 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-01 19:02:05,420 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-10-01 19:02:05,420 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-10-01 19:02:05,420 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-10-01 19:02:05,420 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-10-01 19:02:05,421 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-01 19:02:05,421 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-01 19:02:05,421 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 19:02:05,421 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 19:02:05,421 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-01 19:02:05,421 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportFileSystemState/59dc6410fd5990fd1cdd946339c84185/cf, FileablePath, hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportFileSystemState/59dc6410fd5990fd1cdd946339c84185/recovered.edits] 2023-10-01 19:02:05,421 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportFileSystemState/213160f7f7d3652e366f4b3f050cf2eb/cf, FileablePath, hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportFileSystemState/213160f7f7d3652e366f4b3f050cf2eb/recovered.edits] 2023-10-01 19:02:05,421 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-01 19:02:05,422 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 19:02:05,421 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 19:02:05,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-10-01 19:02:05,426 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportFileSystemState/59dc6410fd5990fd1cdd946339c84185/cf/4434bfe789c4436fa4925b3eaef8453e to hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/archive/data/default/testtb-testExportFileSystemState/59dc6410fd5990fd1cdd946339c84185/cf/4434bfe789c4436fa4925b3eaef8453e 2023-10-01 19:02:05,427 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportFileSystemState/213160f7f7d3652e366f4b3f050cf2eb/cf/83a3f91d08404b2999394412f95a1991 to hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/archive/data/default/testtb-testExportFileSystemState/213160f7f7d3652e366f4b3f050cf2eb/cf/83a3f91d08404b2999394412f95a1991 2023-10-01 19:02:05,430 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportFileSystemState/59dc6410fd5990fd1cdd946339c84185/recovered.edits/9.seqid to hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/archive/data/default/testtb-testExportFileSystemState/59dc6410fd5990fd1cdd946339c84185/recovered.edits/9.seqid 2023-10-01 19:02:05,430 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportFileSystemState/213160f7f7d3652e366f4b3f050cf2eb/recovered.edits/9.seqid to hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/archive/data/default/testtb-testExportFileSystemState/213160f7f7d3652e366f4b3f050cf2eb/recovered.edits/9.seqid 2023-10-01 19:02:05,431 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportFileSystemState/59dc6410fd5990fd1cdd946339c84185 2023-10-01 19:02:05,431 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportFileSystemState/213160f7f7d3652e366f4b3f050cf2eb 2023-10-01 19:02:05,431 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-10-01 19:02:05,431 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-10-01 19:02:05,432 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-10-01 19:02:05,436 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20231001d777b401f68e4592a8a5bd2e24e50e21 to hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20231001d777b401f68e4592a8a5bd2e24e50e21 2023-10-01 19:02:05,438 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202310011c024973446c46709e31e05b99ef5410 to hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202310011c024973446c46709e31e05b99ef5410 2023-10-01 19:02:05,438 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-10-01 19:02:05,441 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-01 19:02:05,444 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-10-01 19:02:05,446 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-10-01 19:02:05,447 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-01 19:02:05,447 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-10-01 19:02:05,448 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1696186909733.59dc6410fd5990fd1cdd946339c84185.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696186925447"}]},"ts":"9223372036854775807"} 2023-10-01 19:02:05,448 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1696186909733.213160f7f7d3652e366f4b3f050cf2eb.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696186925447"}]},"ts":"9223372036854775807"} 2023-10-01 19:02:05,450 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-01 19:02:05,450 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 59dc6410fd5990fd1cdd946339c84185, NAME => 'testtb-testExportFileSystemState,,1696186909733.59dc6410fd5990fd1cdd946339c84185.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 213160f7f7d3652e366f4b3f050cf2eb, NAME => 'testtb-testExportFileSystemState,1,1696186909733.213160f7f7d3652e366f4b3f050cf2eb.', STARTKEY => '1', ENDKEY => ''}] 2023-10-01 19:02:05,450 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-10-01 19:02:05,450 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696186925450"}]},"ts":"9223372036854775807"} 2023-10-01 19:02:05,452 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-10-01 19:02:05,454 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-01 19:02:05,455 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 45 msec 2023-10-01 19:02:05,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-10-01 19:02:05,524 INFO [Listener at jenkins-hbase4.apache.org/36885] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-10-01 19:02:05,531 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-10-01 19:02:05,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-10-01 19:02:05,534 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-10-01 19:02:05,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportFileSystemState 2023-10-01 19:02:05,562 INFO [Listener at jenkins-hbase4.apache.org/36885] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=767 (was 752) Potentially hanging thread: hconnection-0x618534e4-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-2081 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (32912118) connection to jenkins-hbase4.apache.org/172.31.14.131:37919 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (32912118) connection to jenkins-hbase4.apache.org/172.31.14.131:36885 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_502955115_1 at /127.0.0.1:57778 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x618534e4-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-628947520_17 at /127.0.0.1:48104 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x618534e4-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x618534e4-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-628947520_17 at /127.0.0.1:57808 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-628947520_17 at /127.0.0.1:58822 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=939 (was 931) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=264 (was 151) - SystemLoadAverage LEAK? -, ProcessCount=167 (was 167), AvailableMemoryMB=1408 (was 1557) 2023-10-01 19:02:05,562 WARN [Listener at jenkins-hbase4.apache.org/36885] hbase.ResourceChecker(130): Thread=767 is superior to 500 2023-10-01 19:02:05,580 INFO [Listener at jenkins-hbase4.apache.org/36885] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=767, OpenFileDescriptor=939, MaxFileDescriptor=60000, SystemLoadAverage=264, ProcessCount=167, AvailableMemoryMB=1407 2023-10-01 19:02:05,580 WARN [Listener at jenkins-hbase4.apache.org/36885] hbase.ResourceChecker(130): Thread=767 is superior to 500 2023-10-01 19:02:05,582 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-01 19:02:05,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] procedure2.ProcedureExecutor(1028): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-10-01 19:02:05,585 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-10-01 19:02:05,585 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-10-01 19:02:05,586 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-01 19:02:05,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-10-01 19:02:05,589 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testConsecutiveExports/9fc90d250fd81c7628f76f0d59017418 2023-10-01 19:02:05,589 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testConsecutiveExports/f8c02115d2278a4c3a3bc2bbac65936d 2023-10-01 19:02:05,590 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testConsecutiveExports/f8c02115d2278a4c3a3bc2bbac65936d empty. 2023-10-01 19:02:05,590 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testConsecutiveExports/9fc90d250fd81c7628f76f0d59017418 empty. 2023-10-01 19:02:05,590 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testConsecutiveExports/f8c02115d2278a4c3a3bc2bbac65936d 2023-10-01 19:02:05,591 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testConsecutiveExports/9fc90d250fd81c7628f76f0d59017418 2023-10-01 19:02:05,591 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-10-01 19:02:05,601 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-10-01 19:02:05,602 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 9fc90d250fd81c7628f76f0d59017418, NAME => 'testtb-testConsecutiveExports,,1696186925582.9fc90d250fd81c7628f76f0d59017418.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp 2023-10-01 19:02:05,603 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => f8c02115d2278a4c3a3bc2bbac65936d, NAME => 'testtb-testConsecutiveExports,1,1696186925582.f8c02115d2278a4c3a3bc2bbac65936d.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp 2023-10-01 19:02:05,622 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1696186925582.9fc90d250fd81c7628f76f0d59017418.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 19:02:05,622 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 9fc90d250fd81c7628f76f0d59017418, disabling compactions & flushes 2023-10-01 19:02:05,622 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1696186925582.9fc90d250fd81c7628f76f0d59017418. 2023-10-01 19:02:05,622 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1696186925582.9fc90d250fd81c7628f76f0d59017418. 2023-10-01 19:02:05,622 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1696186925582.9fc90d250fd81c7628f76f0d59017418. after waiting 0 ms 2023-10-01 19:02:05,622 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1696186925582.9fc90d250fd81c7628f76f0d59017418. 2023-10-01 19:02:05,622 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1696186925582.9fc90d250fd81c7628f76f0d59017418. 2023-10-01 19:02:05,622 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 9fc90d250fd81c7628f76f0d59017418: 2023-10-01 19:02:05,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-10-01 19:02:05,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-10-01 19:02:06,022 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1696186925582.f8c02115d2278a4c3a3bc2bbac65936d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 19:02:06,022 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing f8c02115d2278a4c3a3bc2bbac65936d, disabling compactions & flushes 2023-10-01 19:02:06,022 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1696186925582.f8c02115d2278a4c3a3bc2bbac65936d. 2023-10-01 19:02:06,022 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1696186925582.f8c02115d2278a4c3a3bc2bbac65936d. 2023-10-01 19:02:06,022 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1696186925582.f8c02115d2278a4c3a3bc2bbac65936d. after waiting 0 ms 2023-10-01 19:02:06,022 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1696186925582.f8c02115d2278a4c3a3bc2bbac65936d. 2023-10-01 19:02:06,022 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1696186925582.f8c02115d2278a4c3a3bc2bbac65936d. 2023-10-01 19:02:06,022 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for f8c02115d2278a4c3a3bc2bbac65936d: 2023-10-01 19:02:06,025 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-10-01 19:02:06,026 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1696186925582.9fc90d250fd81c7628f76f0d59017418.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696186926026"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696186926026"}]},"ts":"1696186926026"} 2023-10-01 19:02:06,026 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1696186925582.f8c02115d2278a4c3a3bc2bbac65936d.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696186926026"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696186926026"}]},"ts":"1696186926026"} 2023-10-01 19:02:06,029 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-01 19:02:06,030 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-01 19:02:06,030 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696186926030"}]},"ts":"1696186926030"} 2023-10-01 19:02:06,031 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-10-01 19:02:06,035 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-01 19:02:06,036 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-01 19:02:06,036 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-01 19:02:06,036 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-01 19:02:06,036 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-01 19:02:06,036 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=9fc90d250fd81c7628f76f0d59017418, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=f8c02115d2278a4c3a3bc2bbac65936d, ASSIGN}] 2023-10-01 19:02:06,039 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=f8c02115d2278a4c3a3bc2bbac65936d, ASSIGN 2023-10-01 19:02:06,039 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=9fc90d250fd81c7628f76f0d59017418, ASSIGN 2023-10-01 19:02:06,040 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=f8c02115d2278a4c3a3bc2bbac65936d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36507,1696186884612; forceNewPlan=false, retain=false 2023-10-01 19:02:06,040 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=9fc90d250fd81c7628f76f0d59017418, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46609,1696186884566; forceNewPlan=false, retain=false 2023-10-01 19:02:06,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-10-01 19:02:06,190 INFO [jenkins-hbase4:42819] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-01 19:02:06,192 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=9fc90d250fd81c7628f76f0d59017418, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:06,192 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=f8c02115d2278a4c3a3bc2bbac65936d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:06,192 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1696186925582.9fc90d250fd81c7628f76f0d59017418.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696186926192"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696186926192"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696186926192"}]},"ts":"1696186926192"} 2023-10-01 19:02:06,192 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1696186925582.f8c02115d2278a4c3a3bc2bbac65936d.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696186926192"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696186926192"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696186926192"}]},"ts":"1696186926192"} 2023-10-01 19:02:06,194 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; OpenRegionProcedure 9fc90d250fd81c7628f76f0d59017418, server=jenkins-hbase4.apache.org,46609,1696186884566}] 2023-10-01 19:02:06,195 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=46, ppid=44, state=RUNNABLE; OpenRegionProcedure f8c02115d2278a4c3a3bc2bbac65936d, server=jenkins-hbase4.apache.org,36507,1696186884612}] 2023-10-01 19:02:06,350 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1696186925582.9fc90d250fd81c7628f76f0d59017418. 2023-10-01 19:02:06,350 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9fc90d250fd81c7628f76f0d59017418, NAME => 'testtb-testConsecutiveExports,,1696186925582.9fc90d250fd81c7628f76f0d59017418.', STARTKEY => '', ENDKEY => '1'} 2023-10-01 19:02:06,350 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1696186925582.f8c02115d2278a4c3a3bc2bbac65936d. 2023-10-01 19:02:06,350 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f8c02115d2278a4c3a3bc2bbac65936d, NAME => 'testtb-testConsecutiveExports,1,1696186925582.f8c02115d2278a4c3a3bc2bbac65936d.', STARTKEY => '1', ENDKEY => ''} 2023-10-01 19:02:06,350 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1696186925582.9fc90d250fd81c7628f76f0d59017418. service=AccessControlService 2023-10-01 19:02:06,350 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1696186925582.f8c02115d2278a4c3a3bc2bbac65936d. service=AccessControlService 2023-10-01 19:02:06,350 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 19:02:06,351 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 19:02:06,351 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 9fc90d250fd81c7628f76f0d59017418 2023-10-01 19:02:06,351 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports f8c02115d2278a4c3a3bc2bbac65936d 2023-10-01 19:02:06,351 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1696186925582.9fc90d250fd81c7628f76f0d59017418.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 19:02:06,351 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1696186925582.f8c02115d2278a4c3a3bc2bbac65936d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 19:02:06,351 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9fc90d250fd81c7628f76f0d59017418 2023-10-01 19:02:06,351 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f8c02115d2278a4c3a3bc2bbac65936d 2023-10-01 19:02:06,351 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9fc90d250fd81c7628f76f0d59017418 2023-10-01 19:02:06,351 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f8c02115d2278a4c3a3bc2bbac65936d 2023-10-01 19:02:06,352 INFO [StoreOpener-9fc90d250fd81c7628f76f0d59017418-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 9fc90d250fd81c7628f76f0d59017418 2023-10-01 19:02:06,352 INFO [StoreOpener-f8c02115d2278a4c3a3bc2bbac65936d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f8c02115d2278a4c3a3bc2bbac65936d 2023-10-01 19:02:06,354 DEBUG [StoreOpener-9fc90d250fd81c7628f76f0d59017418-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testConsecutiveExports/9fc90d250fd81c7628f76f0d59017418/cf 2023-10-01 19:02:06,354 DEBUG [StoreOpener-9fc90d250fd81c7628f76f0d59017418-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testConsecutiveExports/9fc90d250fd81c7628f76f0d59017418/cf 2023-10-01 19:02:06,354 DEBUG [StoreOpener-f8c02115d2278a4c3a3bc2bbac65936d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testConsecutiveExports/f8c02115d2278a4c3a3bc2bbac65936d/cf 2023-10-01 19:02:06,354 DEBUG [StoreOpener-f8c02115d2278a4c3a3bc2bbac65936d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testConsecutiveExports/f8c02115d2278a4c3a3bc2bbac65936d/cf 2023-10-01 19:02:06,354 INFO [StoreOpener-f8c02115d2278a4c3a3bc2bbac65936d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f8c02115d2278a4c3a3bc2bbac65936d columnFamilyName cf 2023-10-01 19:02:06,354 INFO [StoreOpener-9fc90d250fd81c7628f76f0d59017418-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9fc90d250fd81c7628f76f0d59017418 columnFamilyName cf 2023-10-01 19:02:06,356 INFO [StoreOpener-f8c02115d2278a4c3a3bc2bbac65936d-1] regionserver.HStore(310): Store=f8c02115d2278a4c3a3bc2bbac65936d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 19:02:06,356 INFO [StoreOpener-9fc90d250fd81c7628f76f0d59017418-1] regionserver.HStore(310): Store=9fc90d250fd81c7628f76f0d59017418/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 19:02:06,357 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testConsecutiveExports/f8c02115d2278a4c3a3bc2bbac65936d 2023-10-01 19:02:06,357 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testConsecutiveExports/9fc90d250fd81c7628f76f0d59017418 2023-10-01 19:02:06,357 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testConsecutiveExports/f8c02115d2278a4c3a3bc2bbac65936d 2023-10-01 19:02:06,357 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testConsecutiveExports/9fc90d250fd81c7628f76f0d59017418 2023-10-01 19:02:06,360 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9fc90d250fd81c7628f76f0d59017418 2023-10-01 19:02:06,360 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f8c02115d2278a4c3a3bc2bbac65936d 2023-10-01 19:02:06,362 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testConsecutiveExports/f8c02115d2278a4c3a3bc2bbac65936d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-01 19:02:06,362 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testConsecutiveExports/9fc90d250fd81c7628f76f0d59017418/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-01 19:02:06,362 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f8c02115d2278a4c3a3bc2bbac65936d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65379315, jitterRate=-0.02577228844165802}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-01 19:02:06,362 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9fc90d250fd81c7628f76f0d59017418; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75283766, jitterRate=0.12181553244590759}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-01 19:02:06,362 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f8c02115d2278a4c3a3bc2bbac65936d: 2023-10-01 19:02:06,362 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9fc90d250fd81c7628f76f0d59017418: 2023-10-01 19:02:06,363 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1696186925582.f8c02115d2278a4c3a3bc2bbac65936d., pid=46, masterSystemTime=1696186926346 2023-10-01 19:02:06,363 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1696186925582.9fc90d250fd81c7628f76f0d59017418., pid=45, masterSystemTime=1696186926346 2023-10-01 19:02:06,365 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1696186925582.f8c02115d2278a4c3a3bc2bbac65936d. 2023-10-01 19:02:06,365 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1696186925582.f8c02115d2278a4c3a3bc2bbac65936d. 2023-10-01 19:02:06,365 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=f8c02115d2278a4c3a3bc2bbac65936d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:06,365 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1696186925582.9fc90d250fd81c7628f76f0d59017418. 2023-10-01 19:02:06,365 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1696186925582.9fc90d250fd81c7628f76f0d59017418. 2023-10-01 19:02:06,365 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1696186925582.f8c02115d2278a4c3a3bc2bbac65936d.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696186926365"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696186926365"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696186926365"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696186926365"}]},"ts":"1696186926365"} 2023-10-01 19:02:06,366 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=9fc90d250fd81c7628f76f0d59017418, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:06,366 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1696186925582.9fc90d250fd81c7628f76f0d59017418.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696186926366"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696186926366"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696186926366"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696186926366"}]},"ts":"1696186926366"} 2023-10-01 19:02:06,369 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=46, resume processing ppid=44 2023-10-01 19:02:06,369 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=46, ppid=44, state=SUCCESS; OpenRegionProcedure f8c02115d2278a4c3a3bc2bbac65936d, server=jenkins-hbase4.apache.org,36507,1696186884612 in 172 msec 2023-10-01 19:02:06,370 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=45, resume processing ppid=43 2023-10-01 19:02:06,371 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=45, ppid=43, state=SUCCESS; OpenRegionProcedure 9fc90d250fd81c7628f76f0d59017418, server=jenkins-hbase4.apache.org,46609,1696186884566 in 174 msec 2023-10-01 19:02:06,371 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=f8c02115d2278a4c3a3bc2bbac65936d, ASSIGN in 333 msec 2023-10-01 19:02:06,373 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=43, resume processing ppid=42 2023-10-01 19:02:06,373 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=9fc90d250fd81c7628f76f0d59017418, ASSIGN in 335 msec 2023-10-01 19:02:06,373 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-01 19:02:06,374 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696186926374"}]},"ts":"1696186926374"} 2023-10-01 19:02:06,375 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-10-01 19:02:06,377 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-10-01 19:02:06,377 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-10-01 19:02:06,379 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36507] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-10-01 19:02:06,380 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 19:02:06,380 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 19:02:06,380 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 19:02:06,380 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 19:02:06,382 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-10-01 19:02:06,382 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-10-01 19:02:06,382 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-10-01 19:02:06,382 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-10-01 19:02:06,383 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 800 msec 2023-10-01 19:02:06,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-10-01 19:02:06,693 INFO [Listener at jenkins-hbase4.apache.org/36885] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-10-01 19:02:06,696 DEBUG [Listener at jenkins-hbase4.apache.org/36885] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-10-01 19:02:06,696 DEBUG [Listener at jenkins-hbase4.apache.org/36885] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1696186925582.9fc90d250fd81c7628f76f0d59017418. 2023-10-01 19:02:06,697 INFO [Listener at jenkins-hbase4.apache.org/36885] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-01 19:02:06,711 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-01 19:02:06,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696186926711 (current time:1696186926711). 2023-10-01 19:02:06,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-01 19:02:06,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(139): Connect 0x79284a86 to 127.0.0.1:55462 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 19:02:06,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@362be2e9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 19:02:06,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 19:02:06,726 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59230, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 19:02:06,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x79284a86 to 127.0.0.1:55462 2023-10-01 19:02:06,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 19:02:06,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(139): Connect 0x39dcfa44 to 127.0.0.1:55462 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 19:02:06,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@29bfb83, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 19:02:06,740 DEBUG [hconnection-0x6bce6d93-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 19:02:06,743 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59236, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 19:02:06,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 19:02:06,749 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51744, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 19:02:06,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x39dcfa44 to 127.0.0.1:55462 2023-10-01 19:02:06,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 19:02:06,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-10-01 19:02:06,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-01 19:02:06,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-01 19:02:06,754 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot, current working dir path: hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-01 19:02:06,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] procedure2.ProcedureExecutor(1028): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-01 19:02:06,756 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-01 19:02:06,757 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1696187526757 2023-10-01 19:02:06,757 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-10-01 19:02:06,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-01 19:02:06,758 DEBUG [Listener at jenkins-hbase4.apache.org/36885] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-01 19:02:06,758 DEBUG [Listener at jenkins-hbase4.apache.org/36885] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-01 19:02:06,760 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-01 19:02:06,760 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-01 19:02:06,761 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 6 msec 2023-10-01 19:02:06,762 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-01 19:02:06,763 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1696187526763 2023-10-01 19:02:06,778 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-10-01 19:02:06,778 INFO [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-10-01 19:02:06,778 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 19:02:06,779 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-10-01 19:02:06,779 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-10-01 19:02:06,780 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-01 19:02:06,780 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-01 19:02:06,783 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 19:02:06,783 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 19:02:06,783 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 19:02:06,783 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:06,783 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 19:02:06,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 19:02:06,783 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 19:02:06,783 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 19:02:06,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 19:02:06,783 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:06,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 19:02:06,783 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:06,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-01 19:02:06,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-01 19:02:06,784 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:06,784 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-01 19:02:06,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-01 19:02:06,784 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-01 19:02:06,784 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-01 19:02:06,784 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-01 19:02:06,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-10-01 19:02:06,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-01 19:02:06,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-10-01 19:02:06,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-01 19:02:06,785 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-01 19:02:06,785 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-01 19:02:06,785 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-10-01 19:02:06,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-10-01 19:02:06,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-01 19:02:06,785 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-01 19:02:06,785 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-10-01 19:02:06,785 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 19:02:06,785 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-01 19:02:06,786 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-01 19:02:06,786 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-10-01 19:02:06,785 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-01 19:02:06,787 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-10-01 19:02:06,787 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46609,1696186884566' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-10-01 19:02:06,787 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-01 19:02:06,787 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 19:02:06,787 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 19:02:06,788 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-01 19:02:06,791 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-10-01 19:02:06,791 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-01 19:02:06,791 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-10-01 19:02:06,791 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36507,1696186884612' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-10-01 19:02:06,791 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44933,1696186884649' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-10-01 19:02:06,792 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:06,792 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-01 19:02:06,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:06,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 19:02:06,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 19:02:06,793 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:06,793 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-01 19:02:06,794 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-01 19:02:06,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 19:02:06,794 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 19:02:06,794 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-01 19:02:06,794 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-01 19:02:06,794 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 19:02:06,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 19:02:06,795 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-01 19:02:06,795 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 19:02:06,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-01 19:02:06,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:06,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:06,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:06,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 19:02:06,796 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46609,1696186884566' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-10-01 19:02:06,796 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@175645b9[Count = 1] remaining members to acquire global barrier 2023-10-01 19:02:06,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:06,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 19:02:06,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 19:02:06,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 19:02:06,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 19:02:06,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-01 19:02:06,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:06,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:06,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:06,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 19:02:06,798 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36507,1696186884612' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-10-01 19:02:06,798 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@175645b9[Count = 0] remaining members to acquire global barrier 2023-10-01 19:02:06,798 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-10-01 19:02:06,798 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-01 19:02:06,801 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-01 19:02:06,801 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-01 19:02:06,801 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-01 19:02:06,801 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-01 19:02:06,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-01 19:02:06,801 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-01 19:02:06,801 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-01 19:02:06,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-01 19:02:06,801 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:06,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-01 19:02:06,801 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-01 19:02:06,801 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-01 19:02:06,801 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-01 19:02:06,801 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-10-01 19:02:06,801 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,44933,1696186884649' in zk 2023-10-01 19:02:06,801 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 19:02:06,801 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 19:02:06,801 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 19:02:06,801 DEBUG [rs(jenkins-hbase4.apache.org,46609,1696186884566)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1696186925582.9fc90d250fd81c7628f76f0d59017418. 2023-10-01 19:02:06,801 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:06,802 DEBUG [rs(jenkins-hbase4.apache.org,46609,1696186884566)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1696186925582.9fc90d250fd81c7628f76f0d59017418. started... 2023-10-01 19:02:06,801 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1696186925582.f8c02115d2278a4c3a3bc2bbac65936d. 2023-10-01 19:02:06,801 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 19:02:06,802 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1696186925582.f8c02115d2278a4c3a3bc2bbac65936d. started... 2023-10-01 19:02:06,802 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-01 19:02:06,802 DEBUG [rs(jenkins-hbase4.apache.org,46609,1696186884566)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9fc90d250fd81c7628f76f0d59017418: 2023-10-01 19:02:06,803 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f8c02115d2278a4c3a3bc2bbac65936d: 2023-10-01 19:02:06,803 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1696186925582.f8c02115d2278a4c3a3bc2bbac65936d.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-10-01 19:02:06,803 DEBUG [rs(jenkins-hbase4.apache.org,46609,1696186884566)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1696186925582.9fc90d250fd81c7628f76f0d59017418.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-10-01 19:02:06,803 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 19:02:06,803 DEBUG [rs(jenkins-hbase4.apache.org,46609,1696186884566)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 19:02:06,803 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-01 19:02:06,803 DEBUG [rs(jenkins-hbase4.apache.org,46609,1696186884566)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-01 19:02:06,807 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-10-01 19:02:06,808 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 19:02:06,808 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-10-01 19:02:06,813 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1696186925582.f8c02115d2278a4c3a3bc2bbac65936d. completed. 2023-10-01 19:02:06,813 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1696186925582.f8c02115d2278a4c3a3bc2bbac65936d. 2023-10-01 19:02:06,813 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 19:02:06,814 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 19:02:06,814 DEBUG [rs(jenkins-hbase4.apache.org,46609,1696186884566)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1696186925582.9fc90d250fd81c7628f76f0d59017418. completed. 2023-10-01 19:02:06,814 DEBUG [rs(jenkins-hbase4.apache.org,46609,1696186884566)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1696186925582.9fc90d250fd81c7628f76f0d59017418. 2023-10-01 19:02:06,814 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:06,814 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 19:02:06,814 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 19:02:06,814 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:06,814 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-10-01 19:02:06,814 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-10-01 19:02:06,814 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,46609,1696186884566' in zk 2023-10-01 19:02:06,814 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,36507,1696186884612' in zk 2023-10-01 19:02:06,815 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:06,815 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-10-01 19:02:06,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:06,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 19:02:06,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 19:02:06,816 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 19:02:06,815 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:06,815 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-10-01 19:02:06,816 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-10-01 19:02:06,817 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 19:02:06,817 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-10-01 19:02:06,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 19:02:06,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 19:02:06,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-01 19:02:06,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:06,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:06,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:06,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 19:02:06,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-01 19:02:06,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:06,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:06,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:06,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,46609,1696186884566': 2023-10-01 19:02:06,821 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46609,1696186884566' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-10-01 19:02:06,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:06,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 19:02:06,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 19:02:06,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 19:02:06,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 19:02:06,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-01 19:02:06,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:06,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:06,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:06,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 19:02:06,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-01 19:02:06,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:06,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:06,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:06,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,36507,1696186884612': 2023-10-01 19:02:06,824 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36507,1696186884612' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-10-01 19:02:06,824 INFO [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-10-01 19:02:06,824 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-01 19:02:06,824 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-01 19:02:06,824 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-10-01 19:02:06,824 INFO [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-01 19:02:06,826 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-01 19:02:06,826 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-01 19:02:06,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-01 19:02:06,826 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-01 19:02:06,826 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-01 19:02:06,826 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-01 19:02:06,826 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 19:02:06,826 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 19:02:06,826 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-01 19:02:06,826 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-01 19:02:06,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-01 19:02:06,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 19:02:06,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 19:02:06,826 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 19:02:06,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-01 19:02:06,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-01 19:02:06,827 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:06,827 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 19:02:06,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 19:02:06,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 19:02:06,827 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 19:02:06,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 19:02:06,827 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 19:02:06,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 19:02:06,827 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:06,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-01 19:02:06,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-01 19:02:06,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-01 19:02:06,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-01 19:02:06,828 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:06,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 19:02:06,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-01 19:02:06,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:06,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:06,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:06,831 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:06,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 19:02:06,831 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:06,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-01 19:02:06,831 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:06,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:06,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:06,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:06,835 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:06,835 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-01 19:02:06,835 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:06,835 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 19:02:06,835 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:06,835 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 19:02:06,835 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 19:02:06,835 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 19:02:06,835 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 19:02:06,835 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 19:02:06,835 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 19:02:06,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 19:02:06,836 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 19:02:06,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 19:02:06,835 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-10-01 19:02:06,835 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 19:02:06,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 19:02:06,835 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-01 19:02:06,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 19:02:06,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 19:02:06,836 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-10-01 19:02:06,836 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 19:02:06,837 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:06,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 19:02:06,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 19:02:06,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 19:02:06,837 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-01 19:02:06,837 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-10-01 19:02:06,837 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:06,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 19:02:06,837 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:06,837 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-01 19:02:06,837 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-01 19:02:06,837 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-01 19:02:06,838 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-01 19:02:06,846 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-10-01 19:02:06,846 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-10-01 19:02:06,858 DEBUG [Listener at jenkins-hbase4.apache.org/36885] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 19:02:06,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-01 19:02:06,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-10-01 19:02:06,862 DEBUG [Listener at jenkins-hbase4.apache.org/36885] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-01 19:02:06,863 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-10-01 19:02:06,864 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-10-01 19:02:06,864 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-10-01 19:02:06,865 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-10-01 19:02:06,865 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1696186926757Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1696186926846 (+89 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1696186926846Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1696186926846Writing data manifest for emptySnaptb0-testConsecutiveExports at 1696186926849 (+3 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1696186926857 (+8 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1696186926864 (+7 ms) 2023-10-01 19:02:06,870 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-01 19:02:06,872 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 112 msec 2023-10-01 19:02:07,062 DEBUG [Listener at jenkins-hbase4.apache.org/36885] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 19:02:07,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-01 19:02:07,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-01 19:02:07,066 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46609] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1696186925582.9fc90d250fd81c7628f76f0d59017418. with WAL disabled. Data may be lost in the event of a crash. 2023-10-01 19:02:07,067 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36507] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1696186925582.f8c02115d2278a4c3a3bc2bbac65936d. with WAL disabled. Data may be lost in the event of a crash. 2023-10-01 19:02:07,070 DEBUG [Listener at jenkins-hbase4.apache.org/36885] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-10-01 19:02:07,070 DEBUG [Listener at jenkins-hbase4.apache.org/36885] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1696186925582.9fc90d250fd81c7628f76f0d59017418. 2023-10-01 19:02:07,070 INFO [Listener at jenkins-hbase4.apache.org/36885] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-01 19:02:07,080 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-01 19:02:07,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696186927080 (current time:1696186927080). 2023-10-01 19:02:07,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-01 19:02:07,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(139): Connect 0x471a2b6f to 127.0.0.1:55462 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 19:02:07,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@f2ed145, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 19:02:07,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 19:02:07,097 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59244, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 19:02:07,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x471a2b6f to 127.0.0.1:55462 2023-10-01 19:02:07,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 19:02:07,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(139): Connect 0x1bdf7031 to 127.0.0.1:55462 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 19:02:07,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@d887176, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 19:02:07,117 DEBUG [hconnection-0x74553d7b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 19:02:07,118 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59254, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 19:02:07,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 19:02:07,124 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51746, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 19:02:07,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1bdf7031 to 127.0.0.1:55462 2023-10-01 19:02:07,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 19:02:07,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-10-01 19:02:07,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-01 19:02:07,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-01 19:02:07,129 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot, current working dir path: hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-01 19:02:07,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] procedure2.ProcedureExecutor(1028): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-01 19:02:07,131 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-01 19:02:07,132 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1696187527132 2023-10-01 19:02:07,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-01 19:02:07,132 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-10-01 19:02:07,133 DEBUG [Listener at jenkins-hbase4.apache.org/36885] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-01 19:02:07,134 DEBUG [Listener at jenkins-hbase4.apache.org/36885] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-01 19:02:07,134 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-01 19:02:07,135 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-01 19:02:07,136 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 6 msec 2023-10-01 19:02:07,137 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-01 19:02:07,138 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1696187527138 2023-10-01 19:02:07,150 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-10-01 19:02:07,151 INFO [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-10-01 19:02:07,151 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 19:02:07,152 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-10-01 19:02:07,152 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-10-01 19:02:07,152 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-01 19:02:07,153 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-01 19:02:07,154 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:07,154 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 19:02:07,154 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 19:02:07,154 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 19:02:07,154 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 19:02:07,154 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 19:02:07,154 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 19:02:07,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 19:02:07,154 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:07,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 19:02:07,155 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:07,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 19:02:07,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-01 19:02:07,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-01 19:02:07,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-01 19:02:07,155 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:07,155 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-01 19:02:07,155 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-01 19:02:07,156 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-01 19:02:07,156 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-01 19:02:07,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-10-01 19:02:07,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-01 19:02:07,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-10-01 19:02:07,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-01 19:02:07,156 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-01 19:02:07,156 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-01 19:02:07,156 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-10-01 19:02:07,156 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-01 19:02:07,156 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 19:02:07,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-10-01 19:02:07,158 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-01 19:02:07,158 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-10-01 19:02:07,156 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-10-01 19:02:07,158 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44933,1696186884649' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-10-01 19:02:07,158 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-01 19:02:07,158 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 19:02:07,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-01 19:02:07,159 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-01 19:02:07,159 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-10-01 19:02:07,159 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46609,1696186884566' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-10-01 19:02:07,159 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-01 19:02:07,159 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-10-01 19:02:07,159 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-01 19:02:07,159 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 19:02:07,160 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-01 19:02:07,160 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-10-01 19:02:07,160 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36507,1696186884612' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-10-01 19:02:07,161 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-01 19:02:07,162 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:07,162 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-01 19:02:07,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:07,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 19:02:07,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 19:02:07,162 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 19:02:07,162 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-01 19:02:07,168 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:07,168 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-01 19:02:07,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 19:02:07,168 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-01 19:02:07,168 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 19:02:07,169 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-01 19:02:07,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 19:02:07,169 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 19:02:07,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-01 19:02:07,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:07,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:07,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:07,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 19:02:07,170 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46609,1696186884566' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-10-01 19:02:07,170 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7e03d4bf[Count = 1] remaining members to acquire global barrier 2023-10-01 19:02:07,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:07,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 19:02:07,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 19:02:07,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 19:02:07,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 19:02:07,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-01 19:02:07,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:07,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:07,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:07,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 19:02:07,172 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36507,1696186884612' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-10-01 19:02:07,172 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7e03d4bf[Count = 0] remaining members to acquire global barrier 2023-10-01 19:02:07,172 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-10-01 19:02:07,173 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-01 19:02:07,174 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-01 19:02:07,174 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-01 19:02:07,174 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-01 19:02:07,174 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-01 19:02:07,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-01 19:02:07,174 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-01 19:02:07,174 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:07,174 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-01 19:02:07,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-01 19:02:07,174 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-01 19:02:07,174 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-01 19:02:07,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-01 19:02:07,174 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-01 19:02:07,174 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 19:02:07,174 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1696186925582.f8c02115d2278a4c3a3bc2bbac65936d. 2023-10-01 19:02:07,174 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-10-01 19:02:07,174 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,44933,1696186884649' in zk 2023-10-01 19:02:07,174 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:07,175 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-01 19:02:07,174 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1696186925582.f8c02115d2278a4c3a3bc2bbac65936d. started... 2023-10-01 19:02:07,174 DEBUG [rs(jenkins-hbase4.apache.org,46609,1696186884566)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1696186925582.9fc90d250fd81c7628f76f0d59017418. 2023-10-01 19:02:07,174 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 19:02:07,174 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 19:02:07,175 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 19:02:07,175 DEBUG [rs(jenkins-hbase4.apache.org,46609,1696186884566)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1696186925582.9fc90d250fd81c7628f76f0d59017418. started... 2023-10-01 19:02:07,175 INFO [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] regionserver.HRegion(2745): Flushing f8c02115d2278a4c3a3bc2bbac65936d 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-10-01 19:02:07,175 INFO [rs(jenkins-hbase4.apache.org,46609,1696186884566)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 9fc90d250fd81c7628f76f0d59017418 1/1 column families, dataSize=132 B heapSize=544 B 2023-10-01 19:02:07,176 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-10-01 19:02:07,176 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 19:02:07,176 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-10-01 19:02:07,204 INFO [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231001d74ee61a6cc247658b41534bb4726cf6 to hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20231001d74ee61a6cc247658b41534bb4726cf6 2023-10-01 19:02:07,205 INFO [rs(jenkins-hbase4.apache.org,46609,1696186884566)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023100166664ec0f1bd4580960cdf0535a06f31 to hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023100166664ec0f1bd4580960cdf0535a06f31 2023-10-01 19:02:07,212 INFO [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testConsecutiveExports/f8c02115d2278a4c3a3bc2bbac65936d/.tmp/cf/d615b2685bd3499eb60bf896cc76b35f 2023-10-01 19:02:07,213 INFO [rs(jenkins-hbase4.apache.org,46609,1696186884566)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testConsecutiveExports/9fc90d250fd81c7628f76f0d59017418/.tmp/cf/11af168dfbed421f9c41166d159c7461 2023-10-01 19:02:07,218 DEBUG [rs(jenkins-hbase4.apache.org,46609,1696186884566)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testConsecutiveExports/9fc90d250fd81c7628f76f0d59017418/.tmp/cf/11af168dfbed421f9c41166d159c7461 as hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testConsecutiveExports/9fc90d250fd81c7628f76f0d59017418/cf/11af168dfbed421f9c41166d159c7461 2023-10-01 19:02:07,218 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testConsecutiveExports/f8c02115d2278a4c3a3bc2bbac65936d/.tmp/cf/d615b2685bd3499eb60bf896cc76b35f as hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testConsecutiveExports/f8c02115d2278a4c3a3bc2bbac65936d/cf/d615b2685bd3499eb60bf896cc76b35f 2023-10-01 19:02:07,223 INFO [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testConsecutiveExports/f8c02115d2278a4c3a3bc2bbac65936d/cf/d615b2685bd3499eb60bf896cc76b35f, entries=48, sequenceid=6, filesize=12.9 K 2023-10-01 19:02:07,223 INFO [rs(jenkins-hbase4.apache.org,46609,1696186884566)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testConsecutiveExports/9fc90d250fd81c7628f76f0d59017418/cf/11af168dfbed421f9c41166d159c7461, entries=2, sequenceid=6, filesize=5.2 K 2023-10-01 19:02:07,224 INFO [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for f8c02115d2278a4c3a3bc2bbac65936d in 49ms, sequenceid=6, compaction requested=false 2023-10-01 19:02:07,224 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-10-01 19:02:07,225 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f8c02115d2278a4c3a3bc2bbac65936d: 2023-10-01 19:02:07,225 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1696186925582.f8c02115d2278a4c3a3bc2bbac65936d.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-10-01 19:02:07,225 INFO [rs(jenkins-hbase4.apache.org,46609,1696186884566)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 9fc90d250fd81c7628f76f0d59017418 in 50ms, sequenceid=6, compaction requested=false 2023-10-01 19:02:07,225 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 19:02:07,227 DEBUG [rs(jenkins-hbase4.apache.org,46609,1696186884566)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9fc90d250fd81c7628f76f0d59017418: 2023-10-01 19:02:07,227 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testConsecutiveExports/f8c02115d2278a4c3a3bc2bbac65936d/cf/d615b2685bd3499eb60bf896cc76b35f] hfiles 2023-10-01 19:02:07,227 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testConsecutiveExports/f8c02115d2278a4c3a3bc2bbac65936d/cf/d615b2685bd3499eb60bf896cc76b35f for snapshot=snaptb0-testConsecutiveExports 2023-10-01 19:02:07,227 DEBUG [rs(jenkins-hbase4.apache.org,46609,1696186884566)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1696186925582.9fc90d250fd81c7628f76f0d59017418.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-10-01 19:02:07,227 DEBUG [rs(jenkins-hbase4.apache.org,46609,1696186884566)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 19:02:07,227 DEBUG [rs(jenkins-hbase4.apache.org,46609,1696186884566)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testConsecutiveExports/9fc90d250fd81c7628f76f0d59017418/cf/11af168dfbed421f9c41166d159c7461] hfiles 2023-10-01 19:02:07,227 DEBUG [rs(jenkins-hbase4.apache.org,46609,1696186884566)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testConsecutiveExports/9fc90d250fd81c7628f76f0d59017418/cf/11af168dfbed421f9c41166d159c7461 for snapshot=snaptb0-testConsecutiveExports 2023-10-01 19:02:07,234 DEBUG [Listener at jenkins-hbase4.apache.org/36885] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 19:02:07,234 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1696186925582.f8c02115d2278a4c3a3bc2bbac65936d. completed. 2023-10-01 19:02:07,235 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1696186925582.f8c02115d2278a4c3a3bc2bbac65936d. 2023-10-01 19:02:07,235 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 19:02:07,235 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 19:02:07,235 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:07,235 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-10-01 19:02:07,235 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,36507,1696186884612' in zk 2023-10-01 19:02:07,235 DEBUG [rs(jenkins-hbase4.apache.org,46609,1696186884566)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1696186925582.9fc90d250fd81c7628f76f0d59017418. completed. 2023-10-01 19:02:07,235 DEBUG [rs(jenkins-hbase4.apache.org,46609,1696186884566)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1696186925582.9fc90d250fd81c7628f76f0d59017418. 2023-10-01 19:02:07,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-01 19:02:07,235 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 19:02:07,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-10-01 19:02:07,235 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 19:02:07,235 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:07,235 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-10-01 19:02:07,235 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,46609,1696186884566' in zk 2023-10-01 19:02:07,236 DEBUG [Listener at jenkins-hbase4.apache.org/36885] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-01 19:02:07,237 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-10-01 19:02:07,237 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 19:02:07,237 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:07,237 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-10-01 19:02:07,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:07,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 19:02:07,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 19:02:07,240 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:07,240 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-10-01 19:02:07,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 19:02:07,240 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 19:02:07,240 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-10-01 19:02:07,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 19:02:07,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-01 19:02:07,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:07,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:07,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:07,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 19:02:07,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-01 19:02:07,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:07,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:07,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:07,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,36507,1696186884612': 2023-10-01 19:02:07,244 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36507,1696186884612' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-10-01 19:02:07,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:07,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 19:02:07,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 19:02:07,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 19:02:07,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 19:02:07,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-01 19:02:07,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:07,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:07,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:07,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 19:02:07,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-01 19:02:07,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:07,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:07,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:07,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,46609,1696186884566': 2023-10-01 19:02:07,248 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46609,1696186884566' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-10-01 19:02:07,248 INFO [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-10-01 19:02:07,248 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-01 19:02:07,248 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-01 19:02:07,248 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-10-01 19:02:07,248 INFO [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-01 19:02:07,249 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-01 19:02:07,249 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-01 19:02:07,249 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-01 19:02:07,249 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-01 19:02:07,249 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 19:02:07,249 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-01 19:02:07,249 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 19:02:07,250 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 19:02:07,249 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-01 19:02:07,250 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-01 19:02:07,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-01 19:02:07,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-01 19:02:07,250 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:07,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-01 19:02:07,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-01 19:02:07,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 19:02:07,250 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 19:02:07,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 19:02:07,250 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 19:02:07,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 19:02:07,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 19:02:07,250 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:07,250 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 19:02:07,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 19:02:07,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-01 19:02:07,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-01 19:02:07,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 19:02:07,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-01 19:02:07,251 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:07,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-01 19:02:07,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 19:02:07,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-01 19:02:07,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:07,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:07,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:07,253 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:07,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 19:02:07,255 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:07,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-01 19:02:07,255 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:07,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:07,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:07,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:07,262 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 19:02:07,262 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 19:02:07,262 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 19:02:07,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 19:02:07,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 19:02:07,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 19:02:07,262 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 19:02:07,262 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 19:02:07,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 19:02:07,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 19:02:07,263 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-10-01 19:02:07,262 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 19:02:07,263 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-10-01 19:02:07,263 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 19:02:07,263 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-10-01 19:02:07,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 19:02:07,262 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:07,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 19:02:07,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 19:02:07,265 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-01 19:02:07,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 19:02:07,265 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-01 19:02:07,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 19:02:07,265 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:07,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 19:02:07,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 19:02:07,265 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:07,265 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-01 19:02:07,265 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:07,265 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-01 19:02:07,265 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:07,265 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:07,266 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-01 19:02:07,266 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-01 19:02:07,266 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20231001d74ee61a6cc247658b41534bb4726cf6, hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023100166664ec0f1bd4580960cdf0535a06f31] mob files 2023-10-01 19:02:07,266 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20231001d74ee61a6cc247658b41534bb4726cf6 2023-10-01 19:02:07,266 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023100166664ec0f1bd4580960cdf0535a06f31 2023-10-01 19:02:07,274 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-10-01 19:02:07,275 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-01 19:02:07,294 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-01 19:02:07,294 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-10-01 19:02:07,295 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-01 19:02:07,295 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-01 19:02:07,295 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1696186927132Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1696186927274 (+142 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1696186927274Loading Region manifests for snaptb0-testConsecutiveExports at 1696186927274Writing data manifest for snaptb0-testConsecutiveExports at 1696186927278 (+4 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1696186927286 (+8 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1696186927294 (+8 ms) 2023-10-01 19:02:07,297 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-01 19:02:07,299 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 165 msec 2023-10-01 19:02:07,436 DEBUG [Listener at jenkins-hbase4.apache.org/36885] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 19:02:07,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-01 19:02:07,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-01 19:02:07,437 INFO [Listener at jenkins-hbase4.apache.org/36885] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba/local-export-1696186927437 2023-10-01 19:02:07,437 INFO [Listener at jenkins-hbase4.apache.org/36885] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba/local-export-1696186927437, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba/local-export-1696186927437, srcFsUri=hdfs://localhost:38933, srcDir=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399 2023-10-01 19:02:07,459 DEBUG [Listener at jenkins-hbase4.apache.org/36885] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:38933, inputRoot=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399 2023-10-01 19:02:07,459 DEBUG [Listener at jenkins-hbase4.apache.org/36885] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@158f675f, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba/local-export-1696186927437, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba/local-export-1696186927437/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-01 19:02:07,459 INFO [Listener at jenkins-hbase4.apache.org/36885] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:38933, inputRoot=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399, snapshotDir=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-10-01 19:02:07,469 INFO [Listener at jenkins-hbase4.apache.org/36885] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba/local-export-1696186927437/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-01 19:02:07,482 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-01 19:02:07,482 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-01 19:02:07,482 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-01 19:02:07,483 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-01 19:02:08,371 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba/hadoop-3165430187774540964.jar 2023-10-01 19:02:08,372 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-01 19:02:08,372 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-01 19:02:08,439 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba/hadoop-6751897917602274942.jar 2023-10-01 19:02:08,439 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-01 19:02:08,440 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-01 19:02:08,440 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-01 19:02:08,440 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-01 19:02:08,441 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-01 19:02:08,441 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-01 19:02:08,442 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-01 19:02:08,442 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-01 19:02:08,442 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-01 19:02:08,443 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-01 19:02:08,443 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-01 19:02:08,444 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-01 19:02:08,444 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-01 19:02:08,444 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-01 19:02:08,445 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-01 19:02:08,445 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-01 19:02:08,446 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 19:02:08,447 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 19:02:08,447 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 19:02:08,447 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 19:02:08,448 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 19:02:08,448 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 19:02:08,449 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 19:02:08,862 WARN [Listener at jenkins-hbase4.apache.org/36885] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-01 19:02:08,864 INFO [Listener at jenkins-hbase4.apache.org/36885] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-10-01 19:02:08,866 DEBUG [Listener at jenkins-hbase4.apache.org/36885] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-10-01 19:02:09,984 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-01 19:02:09,984 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-01 19:02:09,987 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696186890860_0002_000001 (auth:SIMPLE) 2023-10-01 19:02:10,794 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696186890860_0003_000001 (auth:SIMPLE) 2023-10-01 19:02:10,866 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-01 19:02:14,541 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696186890860_0003_000001 (auth:SIMPLE) 2023-10-01 19:02:16,758 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696186890860_0003_000001 (auth:SIMPLE) 2023-10-01 19:02:19,061 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696186890860_0003_000001 (auth:SIMPLE) 2023-10-01 19:02:21,045 INFO [Listener at jenkins-hbase4.apache.org/36885] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-01 19:02:21,046 INFO [Listener at jenkins-hbase4.apache.org/36885] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-01 19:02:21,051 INFO [Listener at jenkins-hbase4.apache.org/36885] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-10-01 19:02:21,051 INFO [Listener at jenkins-hbase4.apache.org/36885] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-01 19:02:21,052 INFO [Listener at jenkins-hbase4.apache.org/36885] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-01 19:02:21,052 DEBUG [Listener at jenkins-hbase4.apache.org/36885] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-628947520_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-01 19:02:21,055 DEBUG [Listener at jenkins-hbase4.apache.org/36885] snapshot.TestExportSnapshot(367): hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-10-01 19:02:21,055 DEBUG [Listener at jenkins-hbase4.apache.org/36885] snapshot.TestExportSnapshot(367): hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-10-01 19:02:21,055 DEBUG [Listener at jenkins-hbase4.apache.org/36885] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@5a3ee3c in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba/local-export-1696186927437/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba/local-export-1696186927437/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-01 19:02:21,055 DEBUG [Listener at jenkins-hbase4.apache.org/36885] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba/local-export-1696186927437/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-10-01 19:02:21,056 DEBUG [Listener at jenkins-hbase4.apache.org/36885] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba/local-export-1696186927437/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-10-01 19:02:21,057 INFO [Listener at jenkins-hbase4.apache.org/36885] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba/local-export-1696186927437, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba/local-export-1696186927437, srcFsUri=hdfs://localhost:38933, srcDir=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399 2023-10-01 19:02:21,082 DEBUG [Listener at jenkins-hbase4.apache.org/36885] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:38933, inputRoot=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399 2023-10-01 19:02:21,082 DEBUG [Listener at jenkins-hbase4.apache.org/36885] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@27591f3f, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba/local-export-1696186927437, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba/local-export-1696186927437/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-01 19:02:21,082 INFO [Listener at jenkins-hbase4.apache.org/36885] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:38933, inputRoot=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399, snapshotDir=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-10-01 19:02:21,095 INFO [Listener at jenkins-hbase4.apache.org/36885] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba/local-export-1696186927437/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-01 19:02:21,108 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-01 19:02:21,108 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-01 19:02:21,109 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-01 19:02:21,110 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-01 19:02:21,987 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba/hadoop-2370766410738539842.jar 2023-10-01 19:02:21,988 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-01 19:02:21,988 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-01 19:02:22,055 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba/hadoop-7432200083453727332.jar 2023-10-01 19:02:22,056 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-01 19:02:22,056 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-01 19:02:22,057 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-01 19:02:22,058 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-01 19:02:22,058 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-01 19:02:22,059 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-01 19:02:22,059 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-01 19:02:22,060 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-01 19:02:22,060 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-01 19:02:22,061 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-01 19:02:22,061 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-01 19:02:22,062 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-01 19:02:22,062 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-01 19:02:22,062 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-01 19:02:22,062 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-01 19:02:22,063 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-01 19:02:22,064 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 19:02:22,064 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 19:02:22,065 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 19:02:22,065 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 19:02:22,065 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 19:02:22,066 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 19:02:22,066 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 19:02:22,416 WARN [Listener at jenkins-hbase4.apache.org/36885] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-01 19:02:22,418 INFO [Listener at jenkins-hbase4.apache.org/36885] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-10-01 19:02:22,420 DEBUG [Listener at jenkins-hbase4.apache.org/36885] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-10-01 19:02:25,229 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-01 19:02:25,229 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-01 19:02:25,232 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696186890860_0003_000001 (auth:SIMPLE) 2023-10-01 19:02:25,996 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696186890860_0004_000001 (auth:SIMPLE) 2023-10-01 19:02:29,705 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696186890860_0004_000001 (auth:SIMPLE) 2023-10-01 19:02:31,924 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696186890860_0004_000001 (auth:SIMPLE) 2023-10-01 19:02:34,101 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696186890860_0004_000001 (auth:SIMPLE) 2023-10-01 19:02:35,576 INFO [Listener at jenkins-hbase4.apache.org/36885] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-01 19:02:35,577 INFO [Listener at jenkins-hbase4.apache.org/36885] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-01 19:02:35,580 INFO [Listener at jenkins-hbase4.apache.org/36885] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-10-01 19:02:35,580 INFO [Listener at jenkins-hbase4.apache.org/36885] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-01 19:02:35,580 INFO [Listener at jenkins-hbase4.apache.org/36885] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-01 19:02:35,580 DEBUG [Listener at jenkins-hbase4.apache.org/36885] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-628947520_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-01 19:02:35,584 DEBUG [Listener at jenkins-hbase4.apache.org/36885] snapshot.TestExportSnapshot(367): hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-10-01 19:02:35,585 DEBUG [Listener at jenkins-hbase4.apache.org/36885] snapshot.TestExportSnapshot(367): hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-10-01 19:02:35,585 DEBUG [Listener at jenkins-hbase4.apache.org/36885] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@5a3ee3c in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba/local-export-1696186927437/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba/local-export-1696186927437/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-01 19:02:35,585 DEBUG [Listener at jenkins-hbase4.apache.org/36885] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba/local-export-1696186927437/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-10-01 19:02:35,585 DEBUG [Listener at jenkins-hbase4.apache.org/36885] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba/local-export-1696186927437/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-10-01 19:02:35,598 INFO [Listener at jenkins-hbase4.apache.org/36885] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-10-01 19:02:35,598 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-10-01 19:02:35,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] procedure2.ProcedureExecutor(1028): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-10-01 19:02:35,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-10-01 19:02:35,602 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696186955602"}]},"ts":"1696186955602"} 2023-10-01 19:02:35,604 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-10-01 19:02:35,605 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-10-01 19:02:35,606 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=9fc90d250fd81c7628f76f0d59017418, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=f8c02115d2278a4c3a3bc2bbac65936d, UNASSIGN}] 2023-10-01 19:02:35,608 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=9fc90d250fd81c7628f76f0d59017418, UNASSIGN 2023-10-01 19:02:35,608 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=f8c02115d2278a4c3a3bc2bbac65936d, UNASSIGN 2023-10-01 19:02:35,609 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=9fc90d250fd81c7628f76f0d59017418, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:35,609 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=f8c02115d2278a4c3a3bc2bbac65936d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:35,609 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1696186925582.9fc90d250fd81c7628f76f0d59017418.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696186955609"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696186955609"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696186955609"}]},"ts":"1696186955609"} 2023-10-01 19:02:35,609 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1696186925582.f8c02115d2278a4c3a3bc2bbac65936d.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696186955609"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696186955609"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696186955609"}]},"ts":"1696186955609"} 2023-10-01 19:02:35,611 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=54, ppid=52, state=RUNNABLE; CloseRegionProcedure 9fc90d250fd81c7628f76f0d59017418, server=jenkins-hbase4.apache.org,46609,1696186884566}] 2023-10-01 19:02:35,611 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=55, ppid=53, state=RUNNABLE; CloseRegionProcedure f8c02115d2278a4c3a3bc2bbac65936d, server=jenkins-hbase4.apache.org,36507,1696186884612}] 2023-10-01 19:02:35,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-10-01 19:02:35,763 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 9fc90d250fd81c7628f76f0d59017418 2023-10-01 19:02:35,763 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9fc90d250fd81c7628f76f0d59017418, disabling compactions & flushes 2023-10-01 19:02:35,763 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1696186925582.9fc90d250fd81c7628f76f0d59017418. 2023-10-01 19:02:35,763 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1696186925582.9fc90d250fd81c7628f76f0d59017418. 2023-10-01 19:02:35,763 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1696186925582.9fc90d250fd81c7628f76f0d59017418. after waiting 0 ms 2023-10-01 19:02:35,763 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1696186925582.9fc90d250fd81c7628f76f0d59017418. 2023-10-01 19:02:35,765 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f8c02115d2278a4c3a3bc2bbac65936d 2023-10-01 19:02:35,767 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f8c02115d2278a4c3a3bc2bbac65936d, disabling compactions & flushes 2023-10-01 19:02:35,767 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1696186925582.f8c02115d2278a4c3a3bc2bbac65936d. 2023-10-01 19:02:35,767 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1696186925582.f8c02115d2278a4c3a3bc2bbac65936d. 2023-10-01 19:02:35,767 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1696186925582.f8c02115d2278a4c3a3bc2bbac65936d. after waiting 0 ms 2023-10-01 19:02:35,767 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1696186925582.f8c02115d2278a4c3a3bc2bbac65936d. 2023-10-01 19:02:35,774 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testConsecutiveExports/9fc90d250fd81c7628f76f0d59017418/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-01 19:02:35,774 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testConsecutiveExports/f8c02115d2278a4c3a3bc2bbac65936d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-01 19:02:35,774 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 19:02:35,774 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 19:02:35,775 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1696186925582.9fc90d250fd81c7628f76f0d59017418. 2023-10-01 19:02:35,776 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9fc90d250fd81c7628f76f0d59017418: 2023-10-01 19:02:35,776 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1696186925582.f8c02115d2278a4c3a3bc2bbac65936d. 2023-10-01 19:02:35,776 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f8c02115d2278a4c3a3bc2bbac65936d: 2023-10-01 19:02:35,777 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 9fc90d250fd81c7628f76f0d59017418 2023-10-01 19:02:35,778 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=9fc90d250fd81c7628f76f0d59017418, regionState=CLOSED 2023-10-01 19:02:35,778 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f8c02115d2278a4c3a3bc2bbac65936d 2023-10-01 19:02:35,778 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1696186925582.9fc90d250fd81c7628f76f0d59017418.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696186955778"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696186955778"}]},"ts":"1696186955778"} 2023-10-01 19:02:35,778 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=f8c02115d2278a4c3a3bc2bbac65936d, regionState=CLOSED 2023-10-01 19:02:35,778 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1696186925582.f8c02115d2278a4c3a3bc2bbac65936d.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696186955778"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696186955778"}]},"ts":"1696186955778"} 2023-10-01 19:02:35,781 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=54, resume processing ppid=52 2023-10-01 19:02:35,781 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=54, ppid=52, state=SUCCESS; CloseRegionProcedure 9fc90d250fd81c7628f76f0d59017418, server=jenkins-hbase4.apache.org,46609,1696186884566 in 169 msec 2023-10-01 19:02:35,781 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=55, resume processing ppid=53 2023-10-01 19:02:35,781 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=55, ppid=53, state=SUCCESS; CloseRegionProcedure f8c02115d2278a4c3a3bc2bbac65936d, server=jenkins-hbase4.apache.org,36507,1696186884612 in 169 msec 2023-10-01 19:02:35,782 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=9fc90d250fd81c7628f76f0d59017418, UNASSIGN in 175 msec 2023-10-01 19:02:35,783 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=53, resume processing ppid=51 2023-10-01 19:02:35,783 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=f8c02115d2278a4c3a3bc2bbac65936d, UNASSIGN in 175 msec 2023-10-01 19:02:35,784 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696186955784"}]},"ts":"1696186955784"} 2023-10-01 19:02:35,785 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-10-01 19:02:35,786 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-10-01 19:02:35,788 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 189 msec 2023-10-01 19:02:35,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-10-01 19:02:35,905 INFO [Listener at jenkins-hbase4.apache.org/36885] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-10-01 19:02:35,906 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-10-01 19:02:35,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] procedure2.ProcedureExecutor(1028): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-01 19:02:35,909 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-01 19:02:35,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-10-01 19:02:35,910 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-01 19:02:35,912 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36507] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-10-01 19:02:35,915 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testConsecutiveExports/9fc90d250fd81c7628f76f0d59017418 2023-10-01 19:02:35,915 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testConsecutiveExports/f8c02115d2278a4c3a3bc2bbac65936d 2023-10-01 19:02:35,917 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-01 19:02:35,917 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-01 19:02:35,917 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-01 19:02:35,917 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-01 19:02:35,917 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-10-01 19:02:35,918 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-10-01 19:02:35,918 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-10-01 19:02:35,918 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-10-01 19:02:35,918 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testConsecutiveExports/f8c02115d2278a4c3a3bc2bbac65936d/cf, FileablePath, hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testConsecutiveExports/f8c02115d2278a4c3a3bc2bbac65936d/recovered.edits] 2023-10-01 19:02:35,918 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testConsecutiveExports/9fc90d250fd81c7628f76f0d59017418/cf, FileablePath, hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testConsecutiveExports/9fc90d250fd81c7628f76f0d59017418/recovered.edits] 2023-10-01 19:02:35,918 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-01 19:02:35,918 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-01 19:02:35,918 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 19:02:35,918 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 19:02:35,918 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-01 19:02:35,918 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 19:02:35,918 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-01 19:02:35,919 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 19:02:35,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-10-01 19:02:35,924 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testConsecutiveExports/f8c02115d2278a4c3a3bc2bbac65936d/cf/d615b2685bd3499eb60bf896cc76b35f to hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/archive/data/default/testtb-testConsecutiveExports/f8c02115d2278a4c3a3bc2bbac65936d/cf/d615b2685bd3499eb60bf896cc76b35f 2023-10-01 19:02:35,924 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testConsecutiveExports/9fc90d250fd81c7628f76f0d59017418/cf/11af168dfbed421f9c41166d159c7461 to hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/archive/data/default/testtb-testConsecutiveExports/9fc90d250fd81c7628f76f0d59017418/cf/11af168dfbed421f9c41166d159c7461 2023-10-01 19:02:35,927 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testConsecutiveExports/f8c02115d2278a4c3a3bc2bbac65936d/recovered.edits/9.seqid to hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/archive/data/default/testtb-testConsecutiveExports/f8c02115d2278a4c3a3bc2bbac65936d/recovered.edits/9.seqid 2023-10-01 19:02:35,927 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testConsecutiveExports/9fc90d250fd81c7628f76f0d59017418/recovered.edits/9.seqid to hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/archive/data/default/testtb-testConsecutiveExports/9fc90d250fd81c7628f76f0d59017418/recovered.edits/9.seqid 2023-10-01 19:02:35,927 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testConsecutiveExports/f8c02115d2278a4c3a3bc2bbac65936d 2023-10-01 19:02:35,927 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testConsecutiveExports/9fc90d250fd81c7628f76f0d59017418 2023-10-01 19:02:35,927 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-10-01 19:02:35,928 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-10-01 19:02:35,928 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-10-01 19:02:35,932 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20231001d74ee61a6cc247658b41534bb4726cf6 to hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20231001d74ee61a6cc247658b41534bb4726cf6 2023-10-01 19:02:35,933 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023100166664ec0f1bd4580960cdf0535a06f31 to hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023100166664ec0f1bd4580960cdf0535a06f31 2023-10-01 19:02:35,934 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-10-01 19:02:35,936 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-01 19:02:35,938 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-10-01 19:02:35,941 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-10-01 19:02:35,942 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-01 19:02:35,942 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-10-01 19:02:35,942 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1696186925582.9fc90d250fd81c7628f76f0d59017418.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696186955942"}]},"ts":"9223372036854775807"} 2023-10-01 19:02:35,942 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1696186925582.f8c02115d2278a4c3a3bc2bbac65936d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696186955942"}]},"ts":"9223372036854775807"} 2023-10-01 19:02:35,943 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-01 19:02:35,944 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 9fc90d250fd81c7628f76f0d59017418, NAME => 'testtb-testConsecutiveExports,,1696186925582.9fc90d250fd81c7628f76f0d59017418.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => f8c02115d2278a4c3a3bc2bbac65936d, NAME => 'testtb-testConsecutiveExports,1,1696186925582.f8c02115d2278a4c3a3bc2bbac65936d.', STARTKEY => '1', ENDKEY => ''}] 2023-10-01 19:02:35,944 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-10-01 19:02:35,944 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696186955944"}]},"ts":"9223372036854775807"} 2023-10-01 19:02:35,945 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-10-01 19:02:35,947 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-01 19:02:35,948 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 41 msec 2023-10-01 19:02:36,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-10-01 19:02:36,022 INFO [Listener at jenkins-hbase4.apache.org/36885] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-10-01 19:02:36,031 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-10-01 19:02:36,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-10-01 19:02:36,035 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-10-01 19:02:36,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testConsecutiveExports 2023-10-01 19:02:36,060 INFO [Listener at jenkins-hbase4.apache.org/36885] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=751 (was 767), OpenFileDescriptor=905 (was 939), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=219 (was 264), ProcessCount=168 (was 167) - ProcessCount LEAK? -, AvailableMemoryMB=1251 (was 1407) 2023-10-01 19:02:36,060 WARN [Listener at jenkins-hbase4.apache.org/36885] hbase.ResourceChecker(130): Thread=751 is superior to 500 2023-10-01 19:02:36,078 INFO [Listener at jenkins-hbase4.apache.org/36885] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=751, OpenFileDescriptor=905, MaxFileDescriptor=60000, SystemLoadAverage=219, ProcessCount=168, AvailableMemoryMB=1250 2023-10-01 19:02:36,078 WARN [Listener at jenkins-hbase4.apache.org/36885] hbase.ResourceChecker(130): Thread=751 is superior to 500 2023-10-01 19:02:36,080 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-01 19:02:36,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] procedure2.ProcedureExecutor(1028): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:36,083 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-10-01 19:02:36,083 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-10-01 19:02:36,084 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-01 19:02:36,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-10-01 19:02:36,086 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d8ccdbee47d9dad50b067aea85d7bcb5 2023-10-01 19:02:36,086 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0d792d1c4ef8a508b4711b6f0a1ab34d 2023-10-01 19:02:36,087 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d8ccdbee47d9dad50b067aea85d7bcb5 empty. 2023-10-01 19:02:36,087 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0d792d1c4ef8a508b4711b6f0a1ab34d empty. 2023-10-01 19:02:36,087 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d8ccdbee47d9dad50b067aea85d7bcb5 2023-10-01 19:02:36,087 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0d792d1c4ef8a508b4711b6f0a1ab34d 2023-10-01 19:02:36,087 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-10-01 19:02:36,097 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-10-01 19:02:36,098 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => d8ccdbee47d9dad50b067aea85d7bcb5, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1696186956080.d8ccdbee47d9dad50b067aea85d7bcb5.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp 2023-10-01 19:02:36,098 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 0d792d1c4ef8a508b4711b6f0a1ab34d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1696186956080.0d792d1c4ef8a508b4711b6f0a1ab34d.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp 2023-10-01 19:02:36,106 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1696186956080.d8ccdbee47d9dad50b067aea85d7bcb5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 19:02:36,106 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing d8ccdbee47d9dad50b067aea85d7bcb5, disabling compactions & flushes 2023-10-01 19:02:36,106 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1696186956080.d8ccdbee47d9dad50b067aea85d7bcb5. 2023-10-01 19:02:36,106 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1696186956080.d8ccdbee47d9dad50b067aea85d7bcb5. 2023-10-01 19:02:36,106 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1696186956080.d8ccdbee47d9dad50b067aea85d7bcb5. after waiting 0 ms 2023-10-01 19:02:36,106 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1696186956080.d8ccdbee47d9dad50b067aea85d7bcb5. 2023-10-01 19:02:36,106 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1696186956080.d8ccdbee47d9dad50b067aea85d7bcb5. 2023-10-01 19:02:36,106 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for d8ccdbee47d9dad50b067aea85d7bcb5: 2023-10-01 19:02:36,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-10-01 19:02:36,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-10-01 19:02:36,507 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1696186956080.0d792d1c4ef8a508b4711b6f0a1ab34d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 19:02:36,507 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 0d792d1c4ef8a508b4711b6f0a1ab34d, disabling compactions & flushes 2023-10-01 19:02:36,507 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1696186956080.0d792d1c4ef8a508b4711b6f0a1ab34d. 2023-10-01 19:02:36,507 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1696186956080.0d792d1c4ef8a508b4711b6f0a1ab34d. 2023-10-01 19:02:36,507 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1696186956080.0d792d1c4ef8a508b4711b6f0a1ab34d. after waiting 0 ms 2023-10-01 19:02:36,507 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1696186956080.0d792d1c4ef8a508b4711b6f0a1ab34d. 2023-10-01 19:02:36,507 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1696186956080.0d792d1c4ef8a508b4711b6f0a1ab34d. 2023-10-01 19:02:36,507 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 0d792d1c4ef8a508b4711b6f0a1ab34d: 2023-10-01 19:02:36,509 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-10-01 19:02:36,510 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696186956080.d8ccdbee47d9dad50b067aea85d7bcb5.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696186956510"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696186956510"}]},"ts":"1696186956510"} 2023-10-01 19:02:36,511 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696186956080.0d792d1c4ef8a508b4711b6f0a1ab34d.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696186956510"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696186956510"}]},"ts":"1696186956510"} 2023-10-01 19:02:36,517 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-01 19:02:36,517 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-01 19:02:36,518 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696186956518"}]},"ts":"1696186956518"} 2023-10-01 19:02:36,519 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-10-01 19:02:36,523 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-01 19:02:36,524 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-01 19:02:36,524 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-01 19:02:36,524 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-01 19:02:36,524 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-01 19:02:36,524 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=d8ccdbee47d9dad50b067aea85d7bcb5, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0d792d1c4ef8a508b4711b6f0a1ab34d, ASSIGN}] 2023-10-01 19:02:36,526 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=d8ccdbee47d9dad50b067aea85d7bcb5, ASSIGN 2023-10-01 19:02:36,526 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0d792d1c4ef8a508b4711b6f0a1ab34d, ASSIGN 2023-10-01 19:02:36,527 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0d792d1c4ef8a508b4711b6f0a1ab34d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44933,1696186884649; forceNewPlan=false, retain=false 2023-10-01 19:02:36,527 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=d8ccdbee47d9dad50b067aea85d7bcb5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36507,1696186884612; forceNewPlan=false, retain=false 2023-10-01 19:02:36,677 INFO [jenkins-hbase4:42819] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-01 19:02:36,680 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=0d792d1c4ef8a508b4711b6f0a1ab34d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:36,680 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=d8ccdbee47d9dad50b067aea85d7bcb5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:36,680 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696186956080.0d792d1c4ef8a508b4711b6f0a1ab34d.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696186956680"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696186956680"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696186956680"}]},"ts":"1696186956680"} 2023-10-01 19:02:36,680 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696186956080.d8ccdbee47d9dad50b067aea85d7bcb5.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696186956680"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696186956680"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696186956680"}]},"ts":"1696186956680"} 2023-10-01 19:02:36,682 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure 0d792d1c4ef8a508b4711b6f0a1ab34d, server=jenkins-hbase4.apache.org,44933,1696186884649}] 2023-10-01 19:02:36,683 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure d8ccdbee47d9dad50b067aea85d7bcb5, server=jenkins-hbase4.apache.org,36507,1696186884612}] 2023-10-01 19:02:36,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-10-01 19:02:36,839 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1696186956080.d8ccdbee47d9dad50b067aea85d7bcb5. 2023-10-01 19:02:36,840 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d8ccdbee47d9dad50b067aea85d7bcb5, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1696186956080.d8ccdbee47d9dad50b067aea85d7bcb5.', STARTKEY => '', ENDKEY => '1'} 2023-10-01 19:02:36,840 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1696186956080.0d792d1c4ef8a508b4711b6f0a1ab34d. 2023-10-01 19:02:36,840 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0d792d1c4ef8a508b4711b6f0a1ab34d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1696186956080.0d792d1c4ef8a508b4711b6f0a1ab34d.', STARTKEY => '1', ENDKEY => ''} 2023-10-01 19:02:36,840 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1696186956080.d8ccdbee47d9dad50b067aea85d7bcb5. service=AccessControlService 2023-10-01 19:02:36,840 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1696186956080.0d792d1c4ef8a508b4711b6f0a1ab34d. service=AccessControlService 2023-10-01 19:02:36,840 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 19:02:36,840 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 19:02:36,840 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion d8ccdbee47d9dad50b067aea85d7bcb5 2023-10-01 19:02:36,840 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 0d792d1c4ef8a508b4711b6f0a1ab34d 2023-10-01 19:02:36,840 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1696186956080.d8ccdbee47d9dad50b067aea85d7bcb5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 19:02:36,840 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1696186956080.0d792d1c4ef8a508b4711b6f0a1ab34d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 19:02:36,840 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d8ccdbee47d9dad50b067aea85d7bcb5 2023-10-01 19:02:36,840 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0d792d1c4ef8a508b4711b6f0a1ab34d 2023-10-01 19:02:36,840 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d8ccdbee47d9dad50b067aea85d7bcb5 2023-10-01 19:02:36,840 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0d792d1c4ef8a508b4711b6f0a1ab34d 2023-10-01 19:02:36,842 INFO [StoreOpener-0d792d1c4ef8a508b4711b6f0a1ab34d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0d792d1c4ef8a508b4711b6f0a1ab34d 2023-10-01 19:02:36,842 INFO [StoreOpener-d8ccdbee47d9dad50b067aea85d7bcb5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region d8ccdbee47d9dad50b067aea85d7bcb5 2023-10-01 19:02:36,843 DEBUG [StoreOpener-0d792d1c4ef8a508b4711b6f0a1ab34d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemStateWithMergeRegion/0d792d1c4ef8a508b4711b6f0a1ab34d/cf 2023-10-01 19:02:36,843 DEBUG [StoreOpener-d8ccdbee47d9dad50b067aea85d7bcb5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemStateWithMergeRegion/d8ccdbee47d9dad50b067aea85d7bcb5/cf 2023-10-01 19:02:36,843 DEBUG [StoreOpener-d8ccdbee47d9dad50b067aea85d7bcb5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemStateWithMergeRegion/d8ccdbee47d9dad50b067aea85d7bcb5/cf 2023-10-01 19:02:36,843 DEBUG [StoreOpener-0d792d1c4ef8a508b4711b6f0a1ab34d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemStateWithMergeRegion/0d792d1c4ef8a508b4711b6f0a1ab34d/cf 2023-10-01 19:02:36,844 INFO [StoreOpener-d8ccdbee47d9dad50b067aea85d7bcb5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d8ccdbee47d9dad50b067aea85d7bcb5 columnFamilyName cf 2023-10-01 19:02:36,844 INFO [StoreOpener-0d792d1c4ef8a508b4711b6f0a1ab34d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0d792d1c4ef8a508b4711b6f0a1ab34d columnFamilyName cf 2023-10-01 19:02:36,846 INFO [StoreOpener-d8ccdbee47d9dad50b067aea85d7bcb5-1] regionserver.HStore(310): Store=d8ccdbee47d9dad50b067aea85d7bcb5/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 19:02:36,846 INFO [StoreOpener-0d792d1c4ef8a508b4711b6f0a1ab34d-1] regionserver.HStore(310): Store=0d792d1c4ef8a508b4711b6f0a1ab34d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 19:02:36,847 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemStateWithMergeRegion/0d792d1c4ef8a508b4711b6f0a1ab34d 2023-10-01 19:02:36,847 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemStateWithMergeRegion/d8ccdbee47d9dad50b067aea85d7bcb5 2023-10-01 19:02:36,847 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemStateWithMergeRegion/0d792d1c4ef8a508b4711b6f0a1ab34d 2023-10-01 19:02:36,847 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemStateWithMergeRegion/d8ccdbee47d9dad50b067aea85d7bcb5 2023-10-01 19:02:36,850 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d8ccdbee47d9dad50b067aea85d7bcb5 2023-10-01 19:02:36,850 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0d792d1c4ef8a508b4711b6f0a1ab34d 2023-10-01 19:02:36,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemStateWithMergeRegion/d8ccdbee47d9dad50b067aea85d7bcb5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-01 19:02:36,853 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d8ccdbee47d9dad50b067aea85d7bcb5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69762231, jitterRate=0.039538249373435974}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-01 19:02:36,853 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d8ccdbee47d9dad50b067aea85d7bcb5: 2023-10-01 19:02:36,853 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemStateWithMergeRegion/0d792d1c4ef8a508b4711b6f0a1ab34d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-01 19:02:36,853 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0d792d1c4ef8a508b4711b6f0a1ab34d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60499149, jitterRate=-0.09849242866039276}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-01 19:02:36,853 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0d792d1c4ef8a508b4711b6f0a1ab34d: 2023-10-01 19:02:36,854 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1696186956080.d8ccdbee47d9dad50b067aea85d7bcb5., pid=61, masterSystemTime=1696186956834 2023-10-01 19:02:36,854 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1696186956080.0d792d1c4ef8a508b4711b6f0a1ab34d., pid=60, masterSystemTime=1696186956834 2023-10-01 19:02:36,855 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1696186956080.d8ccdbee47d9dad50b067aea85d7bcb5. 2023-10-01 19:02:36,856 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1696186956080.d8ccdbee47d9dad50b067aea85d7bcb5. 2023-10-01 19:02:36,856 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=d8ccdbee47d9dad50b067aea85d7bcb5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:36,856 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1696186956080.0d792d1c4ef8a508b4711b6f0a1ab34d. 2023-10-01 19:02:36,856 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1696186956080.0d792d1c4ef8a508b4711b6f0a1ab34d. 2023-10-01 19:02:36,856 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696186956080.d8ccdbee47d9dad50b067aea85d7bcb5.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696186956856"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696186956856"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696186956856"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696186956856"}]},"ts":"1696186956856"} 2023-10-01 19:02:36,857 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=0d792d1c4ef8a508b4711b6f0a1ab34d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:36,857 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696186956080.0d792d1c4ef8a508b4711b6f0a1ab34d.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696186956857"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696186956857"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696186956857"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696186956857"}]},"ts":"1696186956857"} 2023-10-01 19:02:36,860 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=61, resume processing ppid=58 2023-10-01 19:02:36,860 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure d8ccdbee47d9dad50b067aea85d7bcb5, server=jenkins-hbase4.apache.org,36507,1696186884612 in 175 msec 2023-10-01 19:02:36,862 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=60, resume processing ppid=59 2023-10-01 19:02:36,862 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure 0d792d1c4ef8a508b4711b6f0a1ab34d, server=jenkins-hbase4.apache.org,44933,1696186884649 in 177 msec 2023-10-01 19:02:36,862 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=d8ccdbee47d9dad50b067aea85d7bcb5, ASSIGN in 336 msec 2023-10-01 19:02:36,863 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=59, resume processing ppid=57 2023-10-01 19:02:36,863 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0d792d1c4ef8a508b4711b6f0a1ab34d, ASSIGN in 338 msec 2023-10-01 19:02:36,864 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-01 19:02:36,864 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696186956864"}]},"ts":"1696186956864"} 2023-10-01 19:02:36,865 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-10-01 19:02:36,867 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-10-01 19:02:36,868 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-10-01 19:02:36,869 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36507] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-10-01 19:02:36,871 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 19:02:36,871 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 19:02:36,871 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 19:02:36,871 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 19:02:36,873 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-01 19:02:36,873 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-01 19:02:36,873 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-01 19:02:36,873 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-01 19:02:36,874 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 793 msec 2023-10-01 19:02:37,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-10-01 19:02:37,188 INFO [Listener at jenkins-hbase4.apache.org/36885] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-10-01 19:02:37,190 DEBUG [Listener at jenkins-hbase4.apache.org/36885] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,191 DEBUG [Listener at jenkins-hbase4.apache.org/36885] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1696186956080.d8ccdbee47d9dad50b067aea85d7bcb5. 2023-10-01 19:02:37,193 INFO [Listener at jenkins-hbase4.apache.org/36885] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-01 19:02:37,205 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-01 19:02:37,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696186957205 (current time:1696186957205). 2023-10-01 19:02:37,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-01 19:02:37,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(139): Connect 0x50341155 to 127.0.0.1:55462 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 19:02:37,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4ca3416e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 19:02:37,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 19:02:37,214 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44418, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 19:02:37,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x50341155 to 127.0.0.1:55462 2023-10-01 19:02:37,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 19:02:37,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(139): Connect 0x21fbcac4 to 127.0.0.1:55462 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 19:02:37,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5135c917, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 19:02:37,223 DEBUG [hconnection-0x7cb5a6e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 19:02:37,225 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44422, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 19:02:37,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 19:02:37,231 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59108, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 19:02:37,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x21fbcac4 to 127.0.0.1:55462 2023-10-01 19:02:37,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 19:02:37,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-10-01 19:02:37,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-01 19:02:37,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-01 19:02:37,235 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot, current working dir path: hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-01 19:02:37,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] procedure2.ProcedureExecutor(1028): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-01 19:02:37,237 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-01 19:02:37,238 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1696187557238 2023-10-01 19:02:37,238 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-01 19:02:37,239 DEBUG [Listener at jenkins-hbase4.apache.org/36885] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-01 19:02:37,239 DEBUG [Listener at jenkins-hbase4.apache.org/36885] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-01 19:02:37,240 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-01 19:02:37,240 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-01 19:02:37,241 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 4 msec 2023-10-01 19:02:37,242 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-01 19:02:37,242 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1696187557242 2023-10-01 19:02:37,250 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,251 INFO [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-10-01 19:02:37,251 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 19:02:37,252 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-10-01 19:02:37,252 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-10-01 19:02:37,252 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,252 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,253 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 19:02:37,253 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:37,253 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 19:02:37,253 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 19:02:37,253 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 19:02:37,253 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 19:02:37,253 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 19:02:37,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 19:02:37,253 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:37,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 19:02:37,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 19:02:37,253 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:37,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,254 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:37,254 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-01 19:02:37,254 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,254 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,254 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-10-01 19:02:37,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-10-01 19:02:37,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-10-01 19:02:37,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,255 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-01 19:02:37,255 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-01 19:02:37,255 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-01 19:02:37,255 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,255 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,255 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-01 19:02:37,255 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-01 19:02:37,255 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 19:02:37,255 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,256 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-01 19:02:37,256 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-01 19:02:37,255 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 19:02:37,256 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 19:02:37,256 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-01 19:02:37,258 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-01 19:02:37,258 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-01 19:02:37,257 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-01 19:02:37,258 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36507,1696186884612' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-01 19:02:37,258 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-01 19:02:37,258 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44933,1696186884649' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-01 19:02:37,258 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46609,1696186884566' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-01 19:02:37,259 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,259 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,259 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:37,259 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:37,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:37,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 19:02:37,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 19:02:37,260 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,260 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,260 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 19:02:37,260 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 19:02:37,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 19:02:37,260 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 19:02:37,260 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,260 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 19:02:37,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:37,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:37,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:37,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 19:02:37,262 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44933,1696186884649' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-10-01 19:02:37,262 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2b8088c9[Count = 1] remaining members to acquire global barrier 2023-10-01 19:02:37,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:37,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 19:02:37,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 19:02:37,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 19:02:37,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 19:02:37,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:37,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:37,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:37,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 19:02:37,264 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36507,1696186884612' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-10-01 19:02:37,264 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2b8088c9[Count = 0] remaining members to acquire global barrier 2023-10-01 19:02:37,264 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-10-01 19:02:37,264 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,266 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,266 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,266 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,266 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,266 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,266 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:37,267 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,266 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-01 19:02:37,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,267 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-01 19:02:37,267 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-01 19:02:37,267 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 19:02:37,267 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 19:02:37,267 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1696186956080.d8ccdbee47d9dad50b067aea85d7bcb5. 2023-10-01 19:02:37,267 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 19:02:37,267 DEBUG [rs(jenkins-hbase4.apache.org,44933,1696186884649)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1696186956080.0d792d1c4ef8a508b4711b6f0a1ab34d. 2023-10-01 19:02:37,267 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:37,267 DEBUG [rs(jenkins-hbase4.apache.org,44933,1696186884649)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1696186956080.0d792d1c4ef8a508b4711b6f0a1ab34d. started... 2023-10-01 19:02:37,267 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-01 19:02:37,267 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-01 19:02:37,267 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,46609,1696186884566' in zk 2023-10-01 19:02:37,267 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 19:02:37,267 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1696186956080.d8ccdbee47d9dad50b067aea85d7bcb5. started... 2023-10-01 19:02:37,268 DEBUG [rs(jenkins-hbase4.apache.org,44933,1696186884649)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0d792d1c4ef8a508b4711b6f0a1ab34d: 2023-10-01 19:02:37,268 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d8ccdbee47d9dad50b067aea85d7bcb5: 2023-10-01 19:02:37,268 DEBUG [rs(jenkins-hbase4.apache.org,44933,1696186884649)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1696186956080.0d792d1c4ef8a508b4711b6f0a1ab34d.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,268 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1696186956080.d8ccdbee47d9dad50b067aea85d7bcb5.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,268 DEBUG [rs(jenkins-hbase4.apache.org,44933,1696186884649)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 19:02:37,268 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 19:02:37,268 DEBUG [rs(jenkins-hbase4.apache.org,44933,1696186884649)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-01 19:02:37,268 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-01 19:02:37,278 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1696186956080.d8ccdbee47d9dad50b067aea85d7bcb5. completed. 2023-10-01 19:02:37,278 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1696186956080.d8ccdbee47d9dad50b067aea85d7bcb5. 2023-10-01 19:02:37,278 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 19:02:37,278 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 19:02:37,278 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-01 19:02:37,278 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 19:02:37,278 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:37,278 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-01 19:02:37,279 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-01 19:02:37,279 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,36507,1696186884612' in zk 2023-10-01 19:02:37,280 DEBUG [rs(jenkins-hbase4.apache.org,44933,1696186884649)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1696186956080.0d792d1c4ef8a508b4711b6f0a1ab34d. completed. 2023-10-01 19:02:37,280 DEBUG [rs(jenkins-hbase4.apache.org,44933,1696186884649)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1696186956080.0d792d1c4ef8a508b4711b6f0a1ab34d. 2023-10-01 19:02:37,280 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 19:02:37,280 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 19:02:37,280 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:37,280 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-01 19:02:37,280 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,44933,1696186884649' in zk 2023-10-01 19:02:37,281 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-01 19:02:37,281 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:37,281 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 19:02:37,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:37,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 19:02:37,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 19:02:37,281 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-01 19:02:37,284 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:37,284 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-01 19:02:37,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 19:02:37,284 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 19:02:37,284 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-01 19:02:37,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 19:02:37,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:37,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:37,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:37,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 19:02:37,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:37,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:37,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:37,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,36507,1696186884612': 2023-10-01 19:02:37,288 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36507,1696186884612' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-10-01 19:02:37,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:37,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 19:02:37,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 19:02:37,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 19:02:37,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 19:02:37,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:37,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:37,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:37,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 19:02:37,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:37,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:37,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:37,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,44933,1696186884649': 2023-10-01 19:02:37,291 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44933,1696186884649' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-10-01 19:02:37,291 INFO [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-10-01 19:02:37,291 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-01 19:02:37,291 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-01 19:02:37,291 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,291 INFO [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-01 19:02:37,293 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,293 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,293 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 19:02:37,293 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,293 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,293 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,293 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 19:02:37,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 19:02:37,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 19:02:37,293 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 19:02:37,293 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,293 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 19:02:37,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,294 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:37,294 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 19:02:37,294 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 19:02:37,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 19:02:37,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,294 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 19:02:37,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 19:02:37,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 19:02:37,294 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:37,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 19:02:37,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,295 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:37,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:37,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:37,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:37,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 19:02:37,296 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:37,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,297 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:37,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:37,297 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:37,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:37,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:37,300 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:37,300 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,300 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 19:02:37,300 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:37,300 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:37,300 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 19:02:37,300 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 19:02:37,300 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 19:02:37,300 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 19:02:37,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 19:02:37,300 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 19:02:37,300 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 19:02:37,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 19:02:37,300 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 19:02:37,300 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 19:02:37,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 19:02:37,301 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 19:02:37,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 19:02:37,301 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 19:02:37,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 19:02:37,301 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,301 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:37,301 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,301 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 19:02:37,301 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:37,301 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 19:02:37,301 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 19:02:37,303 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,303 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:37,303 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,303 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,303 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-01 19:02:37,303 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,304 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-01 19:02:37,318 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,319 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,335 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,336 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-10-01 19:02:37,336 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,336 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,336 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1696186957238Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1696186957318 (+80 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1696186957318Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1696186957318Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1696186957321 (+3 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1696186957330 (+9 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1696186957336 (+6 ms) 2023-10-01 19:02:37,339 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-01 19:02:37,339 DEBUG [Listener at jenkins-hbase4.apache.org/36885] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 19:02:37,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-10-01 19:02:37,340 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 100 msec 2023-10-01 19:02:37,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-01 19:02:37,343 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36507] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1696186956080.d8ccdbee47d9dad50b067aea85d7bcb5. with WAL disabled. Data may be lost in the event of a crash. 2023-10-01 19:02:37,344 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44933] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1696186956080.0d792d1c4ef8a508b4711b6f0a1ab34d. with WAL disabled. Data may be lost in the event of a crash. 2023-10-01 19:02:37,347 DEBUG [Listener at jenkins-hbase4.apache.org/36885] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,347 DEBUG [Listener at jenkins-hbase4.apache.org/36885] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1696186956080.d8ccdbee47d9dad50b067aea85d7bcb5. 2023-10-01 19:02:37,347 INFO [Listener at jenkins-hbase4.apache.org/36885] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-01 19:02:37,356 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-01 19:02:37,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696186957356 (current time:1696186957356). 2023-10-01 19:02:37,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-01 19:02:37,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(139): Connect 0x6a769500 to 127.0.0.1:55462 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 19:02:37,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4854e5dd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 19:02:37,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 19:02:37,368 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44438, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 19:02:37,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6a769500 to 127.0.0.1:55462 2023-10-01 19:02:37,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 19:02:37,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(139): Connect 0x42ef925a to 127.0.0.1:55462 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 19:02:37,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1cefd192, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 19:02:37,375 DEBUG [hconnection-0x737ab5df-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 19:02:37,378 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44444, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 19:02:37,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 19:02:37,383 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59114, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 19:02:37,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x42ef925a to 127.0.0.1:55462 2023-10-01 19:02:37,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 19:02:37,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-10-01 19:02:37,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-01 19:02:37,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-01 19:02:37,388 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot, current working dir path: hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-01 19:02:37,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] procedure2.ProcedureExecutor(1028): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-01 19:02:37,390 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-01 19:02:37,390 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1696187557390 2023-10-01 19:02:37,390 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-01 19:02:37,392 DEBUG [Listener at jenkins-hbase4.apache.org/36885] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-01 19:02:37,392 DEBUG [Listener at jenkins-hbase4.apache.org/36885] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-01 19:02:37,393 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-01 19:02:37,393 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-01 19:02:37,394 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-10-01 19:02:37,395 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-01 19:02:37,395 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1696187557395 2023-10-01 19:02:37,406 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,406 INFO [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-10-01 19:02:37,407 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 19:02:37,408 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-10-01 19:02:37,408 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-10-01 19:02:37,408 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,408 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,409 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 19:02:37,409 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:37,409 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 19:02:37,409 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 19:02:37,409 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 19:02:37,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 19:02:37,409 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 19:02:37,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 19:02:37,410 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:37,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 19:02:37,410 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:37,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 19:02:37,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,410 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:37,410 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,410 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,410 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-01 19:02:37,410 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-10-01 19:02:37,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-10-01 19:02:37,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,411 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-01 19:02:37,411 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-01 19:02:37,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-10-01 19:02:37,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,411 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,411 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,411 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-01 19:02:37,411 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-01 19:02:37,411 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-01 19:02:37,411 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 19:02:37,411 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 19:02:37,412 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,412 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-01 19:02:37,412 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-01 19:02:37,412 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-01 19:02:37,412 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 19:02:37,412 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36507,1696186884612' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-01 19:02:37,413 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-01 19:02:37,413 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-01 19:02:37,413 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44933,1696186884649' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-01 19:02:37,412 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-01 19:02:37,413 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-01 19:02:37,413 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46609,1696186884566' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-01 19:02:37,415 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,415 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:37,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:37,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 19:02:37,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 19:02:37,416 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:37,416 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,416 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,417 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 19:02:37,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 19:02:37,416 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,417 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,417 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 19:02:37,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 19:02:37,418 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,418 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 19:02:37,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:37,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:37,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:37,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 19:02:37,419 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36507,1696186884612' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-10-01 19:02:37,419 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@556b1474[Count = 1] remaining members to acquire global barrier 2023-10-01 19:02:37,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:37,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 19:02:37,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 19:02:37,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 19:02:37,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 19:02:37,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:37,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:37,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:37,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 19:02:37,421 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44933,1696186884649' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-10-01 19:02:37,421 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@556b1474[Count = 0] remaining members to acquire global barrier 2023-10-01 19:02:37,421 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-10-01 19:02:37,421 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,422 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,422 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,422 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,422 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,422 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,423 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-01 19:02:37,423 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:37,423 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,423 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-01 19:02:37,423 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-01 19:02:37,423 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-01 19:02:37,423 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:37,423 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,46609,1696186884566' in zk 2023-10-01 19:02:37,423 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-01 19:02:37,423 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 19:02:37,423 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 19:02:37,423 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1696186956080.d8ccdbee47d9dad50b067aea85d7bcb5. 2023-10-01 19:02:37,423 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 19:02:37,423 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 19:02:37,423 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1696186956080.d8ccdbee47d9dad50b067aea85d7bcb5. started... 2023-10-01 19:02:37,423 DEBUG [rs(jenkins-hbase4.apache.org,44933,1696186884649)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1696186956080.0d792d1c4ef8a508b4711b6f0a1ab34d. 2023-10-01 19:02:37,423 DEBUG [rs(jenkins-hbase4.apache.org,44933,1696186884649)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1696186956080.0d792d1c4ef8a508b4711b6f0a1ab34d. started... 2023-10-01 19:02:37,423 INFO [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] regionserver.HRegion(2745): Flushing d8ccdbee47d9dad50b067aea85d7bcb5 1/1 column families, dataSize=132 B heapSize=544 B 2023-10-01 19:02:37,424 INFO [rs(jenkins-hbase4.apache.org,44933,1696186884649)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 0d792d1c4ef8a508b4711b6f0a1ab34d 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-10-01 19:02:37,424 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-01 19:02:37,424 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 19:02:37,424 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-01 19:02:37,442 INFO [rs(jenkins-hbase4.apache.org,44933,1696186884649)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310019d974567af524b5699c3b3dcfee5c03a to hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202310019d974567af524b5699c3b3dcfee5c03a 2023-10-01 19:02:37,442 INFO [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310019361665ca8a540dbb8a43312be4674d9 to hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202310019361665ca8a540dbb8a43312be4674d9 2023-10-01 19:02:37,450 INFO [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemStateWithMergeRegion/d8ccdbee47d9dad50b067aea85d7bcb5/.tmp/cf/41a13faa3f0746eca81b7bd18cd5bdaf 2023-10-01 19:02:37,450 INFO [rs(jenkins-hbase4.apache.org,44933,1696186884649)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemStateWithMergeRegion/0d792d1c4ef8a508b4711b6f0a1ab34d/.tmp/cf/904f9cc061e64e07b7c4184a22c8e63f 2023-10-01 19:02:37,455 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemStateWithMergeRegion/d8ccdbee47d9dad50b067aea85d7bcb5/.tmp/cf/41a13faa3f0746eca81b7bd18cd5bdaf as hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemStateWithMergeRegion/d8ccdbee47d9dad50b067aea85d7bcb5/cf/41a13faa3f0746eca81b7bd18cd5bdaf 2023-10-01 19:02:37,455 DEBUG [rs(jenkins-hbase4.apache.org,44933,1696186884649)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemStateWithMergeRegion/0d792d1c4ef8a508b4711b6f0a1ab34d/.tmp/cf/904f9cc061e64e07b7c4184a22c8e63f as hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemStateWithMergeRegion/0d792d1c4ef8a508b4711b6f0a1ab34d/cf/904f9cc061e64e07b7c4184a22c8e63f 2023-10-01 19:02:37,460 INFO [rs(jenkins-hbase4.apache.org,44933,1696186884649)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemStateWithMergeRegion/0d792d1c4ef8a508b4711b6f0a1ab34d/cf/904f9cc061e64e07b7c4184a22c8e63f, entries=48, sequenceid=6, filesize=13.7 K 2023-10-01 19:02:37,461 INFO [rs(jenkins-hbase4.apache.org,44933,1696186884649)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 0d792d1c4ef8a508b4711b6f0a1ab34d in 37ms, sequenceid=6, compaction requested=false 2023-10-01 19:02:37,461 DEBUG [rs(jenkins-hbase4.apache.org,44933,1696186884649)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-10-01 19:02:37,461 DEBUG [rs(jenkins-hbase4.apache.org,44933,1696186884649)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0d792d1c4ef8a508b4711b6f0a1ab34d: 2023-10-01 19:02:37,462 DEBUG [rs(jenkins-hbase4.apache.org,44933,1696186884649)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1696186956080.0d792d1c4ef8a508b4711b6f0a1ab34d.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,462 DEBUG [rs(jenkins-hbase4.apache.org,44933,1696186884649)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 19:02:37,462 DEBUG [rs(jenkins-hbase4.apache.org,44933,1696186884649)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemStateWithMergeRegion/0d792d1c4ef8a508b4711b6f0a1ab34d/cf/904f9cc061e64e07b7c4184a22c8e63f] hfiles 2023-10-01 19:02:37,462 DEBUG [rs(jenkins-hbase4.apache.org,44933,1696186884649)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemStateWithMergeRegion/0d792d1c4ef8a508b4711b6f0a1ab34d/cf/904f9cc061e64e07b7c4184a22c8e63f for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,462 INFO [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemStateWithMergeRegion/d8ccdbee47d9dad50b067aea85d7bcb5/cf/41a13faa3f0746eca81b7bd18cd5bdaf, entries=2, sequenceid=6, filesize=5.3 K 2023-10-01 19:02:37,463 INFO [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for d8ccdbee47d9dad50b067aea85d7bcb5 in 40ms, sequenceid=6, compaction requested=false 2023-10-01 19:02:37,465 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d8ccdbee47d9dad50b067aea85d7bcb5: 2023-10-01 19:02:37,465 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1696186956080.d8ccdbee47d9dad50b067aea85d7bcb5.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,465 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 19:02:37,465 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemStateWithMergeRegion/d8ccdbee47d9dad50b067aea85d7bcb5/cf/41a13faa3f0746eca81b7bd18cd5bdaf] hfiles 2023-10-01 19:02:37,465 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemStateWithMergeRegion/d8ccdbee47d9dad50b067aea85d7bcb5/cf/41a13faa3f0746eca81b7bd18cd5bdaf for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,473 DEBUG [rs(jenkins-hbase4.apache.org,44933,1696186884649)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1696186956080.0d792d1c4ef8a508b4711b6f0a1ab34d. completed. 2023-10-01 19:02:37,473 DEBUG [rs(jenkins-hbase4.apache.org,44933,1696186884649)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1696186956080.0d792d1c4ef8a508b4711b6f0a1ab34d. 2023-10-01 19:02:37,473 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 19:02:37,473 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 19:02:37,473 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1696186956080.d8ccdbee47d9dad50b067aea85d7bcb5. completed. 2023-10-01 19:02:37,473 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1696186956080.d8ccdbee47d9dad50b067aea85d7bcb5. 2023-10-01 19:02:37,473 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:37,473 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 19:02:37,473 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 19:02:37,474 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:37,473 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-01 19:02:37,474 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-01 19:02:37,474 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,36507,1696186884612' in zk 2023-10-01 19:02:37,474 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,44933,1696186884649' in zk 2023-10-01 19:02:37,476 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:37,476 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-01 19:02:37,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:37,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 19:02:37,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 19:02:37,476 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 19:02:37,476 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:37,476 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-01 19:02:37,476 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-01 19:02:37,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 19:02:37,478 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 19:02:37,478 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-01 19:02:37,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 19:02:37,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:37,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:37,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:37,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 19:02:37,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:37,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:37,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:37,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,44933,1696186884649': 2023-10-01 19:02:37,482 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44933,1696186884649' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-10-01 19:02:37,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:37,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 19:02:37,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 19:02:37,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 19:02:37,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 19:02:37,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:37,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:37,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:37,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 19:02:37,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:37,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:37,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:37,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,36507,1696186884612': 2023-10-01 19:02:37,485 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36507,1696186884612' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-10-01 19:02:37,485 INFO [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-10-01 19:02:37,485 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-01 19:02:37,486 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-01 19:02:37,486 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,486 INFO [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-01 19:02:37,490 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,490 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,490 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 19:02:37,490 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 19:02:37,490 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,490 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 19:02:37,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 19:02:37,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,490 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 19:02:37,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,490 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:37,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 19:02:37,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 19:02:37,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 19:02:37,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 19:02:37,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 19:02:37,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 19:02:37,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 19:02:37,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,491 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:37,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,492 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:37,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 19:02:37,492 DEBUG [Listener at jenkins-hbase4.apache.org/36885] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 19:02:37,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:37,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:37,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-10-01 19:02:37,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-10-01 19:02:37,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:37,493 DEBUG [Listener at jenkins-hbase4.apache.org/36885] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-01 19:02:37,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 19:02:37,494 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:37,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,494 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:37,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:37,494 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:37,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:37,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:37,497 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 19:02:37,498 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:37,498 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 19:02:37,498 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,498 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 19:02:37,498 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 19:02:37,498 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:37,498 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 19:02:37,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 19:02:37,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 19:02:37,498 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:37,498 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 19:02:37,498 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,498 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,498 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 19:02:37,498 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 19:02:37,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 19:02:37,500 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 19:02:37,498 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,498 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:37,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 19:02:37,500 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 19:02:37,500 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,500 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,500 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-01 19:02:37,501 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:37,500 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 19:02:37,500 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 19:02:37,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 19:02:37,501 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:37,501 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,501 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,501 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 19:02:37,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 19:02:37,501 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202310019d974567af524b5699c3b3dcfee5c03a, hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202310019361665ca8a540dbb8a43312be4674d9] mob files 2023-10-01 19:02:37,501 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202310019d974567af524b5699c3b3dcfee5c03a 2023-10-01 19:02:37,501 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202310019361665ca8a540dbb8a43312be4674d9 2023-10-01 19:02:37,511 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,512 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,532 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,532 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-10-01 19:02:37,533 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,533 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:37,533 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1696186957390Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1696186957511 (+121 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1696186957511Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1696186957511Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1696186957514 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1696186957525 (+11 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1696186957532 (+7 ms) 2023-10-01 19:02:37,535 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-01 19:02:37,537 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 144 msec 2023-10-01 19:02:37,693 DEBUG [Listener at jenkins-hbase4.apache.org/36885] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 19:02:37,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-10-01 19:02:37,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-01 19:02:37,722 DEBUG [Listener at jenkins-hbase4.apache.org/36885] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-01 19:02:37,726 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59124, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-01 19:02:37,728 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36507] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-10-01 19:02:37,728 DEBUG [Listener at jenkins-hbase4.apache.org/36885] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-01 19:02:37,731 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44448, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-01 19:02:37,731 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44933] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-10-01 19:02:37,732 DEBUG [Listener at jenkins-hbase4.apache.org/36885] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-01 19:02:37,767 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32794, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-01 19:02:37,767 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46609] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-10-01 19:02:37,772 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-10-01 19:02:37,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] procedure2.ProcedureExecutor(1028): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 19:02:37,775 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-10-01 19:02:37,775 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-10-01 19:02:37,776 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-01 19:02:37,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-10-01 19:02:37,778 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/11ece1e1674a15d47e59e77a63687165 2023-10-01 19:02:37,778 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/28ddedd47438cf00d9ebd2bd1c149ca0 2023-10-01 19:02:37,779 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/11ece1e1674a15d47e59e77a63687165 empty. 2023-10-01 19:02:37,779 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/28ddedd47438cf00d9ebd2bd1c149ca0 empty. 2023-10-01 19:02:37,779 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/11ece1e1674a15d47e59e77a63687165 2023-10-01 19:02:37,779 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/28ddedd47438cf00d9ebd2bd1c149ca0 2023-10-01 19:02:37,779 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-10-01 19:02:37,789 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-10-01 19:02:37,790 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 11ece1e1674a15d47e59e77a63687165, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696186957772.11ece1e1674a15d47e59e77a63687165.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp 2023-10-01 19:02:37,791 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 28ddedd47438cf00d9ebd2bd1c149ca0, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1696186957772.28ddedd47438cf00d9ebd2bd1c149ca0.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp 2023-10-01 19:02:37,798 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1696186957772.11ece1e1674a15d47e59e77a63687165.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 19:02:37,798 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 11ece1e1674a15d47e59e77a63687165, disabling compactions & flushes 2023-10-01 19:02:37,798 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1696186957772.11ece1e1674a15d47e59e77a63687165. 2023-10-01 19:02:37,798 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696186957772.11ece1e1674a15d47e59e77a63687165. 2023-10-01 19:02:37,798 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696186957772.11ece1e1674a15d47e59e77a63687165. after waiting 0 ms 2023-10-01 19:02:37,798 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1696186957772.28ddedd47438cf00d9ebd2bd1c149ca0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 19:02:37,798 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1696186957772.11ece1e1674a15d47e59e77a63687165. 2023-10-01 19:02:37,798 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 28ddedd47438cf00d9ebd2bd1c149ca0, disabling compactions & flushes 2023-10-01 19:02:37,798 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1696186957772.11ece1e1674a15d47e59e77a63687165. 2023-10-01 19:02:37,798 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1696186957772.28ddedd47438cf00d9ebd2bd1c149ca0. 2023-10-01 19:02:37,798 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1696186957772.28ddedd47438cf00d9ebd2bd1c149ca0. 2023-10-01 19:02:37,798 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 11ece1e1674a15d47e59e77a63687165: 2023-10-01 19:02:37,798 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1696186957772.28ddedd47438cf00d9ebd2bd1c149ca0. after waiting 0 ms 2023-10-01 19:02:37,798 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1696186957772.28ddedd47438cf00d9ebd2bd1c149ca0. 2023-10-01 19:02:37,798 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1696186957772.28ddedd47438cf00d9ebd2bd1c149ca0. 2023-10-01 19:02:37,798 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 28ddedd47438cf00d9ebd2bd1c149ca0: 2023-10-01 19:02:37,800 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-10-01 19:02:37,801 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696186957772.11ece1e1674a15d47e59e77a63687165.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696186957801"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696186957801"}]},"ts":"1696186957801"} 2023-10-01 19:02:37,801 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696186957772.28ddedd47438cf00d9ebd2bd1c149ca0.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696186957801"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696186957801"}]},"ts":"1696186957801"} 2023-10-01 19:02:37,803 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-01 19:02:37,804 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-01 19:02:37,804 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696186957804"}]},"ts":"1696186957804"} 2023-10-01 19:02:37,805 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-10-01 19:02:37,809 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-01 19:02:37,810 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-01 19:02:37,810 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-01 19:02:37,810 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-01 19:02:37,810 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-01 19:02:37,810 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=11ece1e1674a15d47e59e77a63687165, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=28ddedd47438cf00d9ebd2bd1c149ca0, ASSIGN}] 2023-10-01 19:02:37,813 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=28ddedd47438cf00d9ebd2bd1c149ca0, ASSIGN 2023-10-01 19:02:37,813 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=11ece1e1674a15d47e59e77a63687165, ASSIGN 2023-10-01 19:02:37,814 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=28ddedd47438cf00d9ebd2bd1c149ca0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36507,1696186884612; forceNewPlan=false, retain=false 2023-10-01 19:02:37,814 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=11ece1e1674a15d47e59e77a63687165, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46609,1696186884566; forceNewPlan=false, retain=false 2023-10-01 19:02:37,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-10-01 19:02:37,964 INFO [jenkins-hbase4:42819] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-01 19:02:37,967 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=28ddedd47438cf00d9ebd2bd1c149ca0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:37,967 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=11ece1e1674a15d47e59e77a63687165, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:37,967 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696186957772.28ddedd47438cf00d9ebd2bd1c149ca0.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696186957967"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696186957967"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696186957967"}]},"ts":"1696186957967"} 2023-10-01 19:02:37,967 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696186957772.11ece1e1674a15d47e59e77a63687165.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696186957967"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696186957967"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696186957967"}]},"ts":"1696186957967"} 2023-10-01 19:02:37,968 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 11ece1e1674a15d47e59e77a63687165, server=jenkins-hbase4.apache.org,46609,1696186884566}] 2023-10-01 19:02:37,969 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=70, ppid=68, state=RUNNABLE; OpenRegionProcedure 28ddedd47438cf00d9ebd2bd1c149ca0, server=jenkins-hbase4.apache.org,36507,1696186884612}] 2023-10-01 19:02:38,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-10-01 19:02:38,123 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1696186957772.28ddedd47438cf00d9ebd2bd1c149ca0. 2023-10-01 19:02:38,123 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1696186957772.11ece1e1674a15d47e59e77a63687165. 2023-10-01 19:02:38,123 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 28ddedd47438cf00d9ebd2bd1c149ca0, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1696186957772.28ddedd47438cf00d9ebd2bd1c149ca0.', STARTKEY => '2', ENDKEY => ''} 2023-10-01 19:02:38,124 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 11ece1e1674a15d47e59e77a63687165, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696186957772.11ece1e1674a15d47e59e77a63687165.', STARTKEY => '', ENDKEY => '2'} 2023-10-01 19:02:38,124 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1696186957772.28ddedd47438cf00d9ebd2bd1c149ca0. service=AccessControlService 2023-10-01 19:02:38,124 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1696186957772.11ece1e1674a15d47e59e77a63687165. service=AccessControlService 2023-10-01 19:02:38,124 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 19:02:38,124 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 19:02:38,124 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 28ddedd47438cf00d9ebd2bd1c149ca0 2023-10-01 19:02:38,124 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 11ece1e1674a15d47e59e77a63687165 2023-10-01 19:02:38,124 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1696186957772.28ddedd47438cf00d9ebd2bd1c149ca0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 19:02:38,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1696186957772.11ece1e1674a15d47e59e77a63687165.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 19:02:38,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 28ddedd47438cf00d9ebd2bd1c149ca0 2023-10-01 19:02:38,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 11ece1e1674a15d47e59e77a63687165 2023-10-01 19:02:38,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 28ddedd47438cf00d9ebd2bd1c149ca0 2023-10-01 19:02:38,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 11ece1e1674a15d47e59e77a63687165 2023-10-01 19:02:38,126 INFO [StoreOpener-28ddedd47438cf00d9ebd2bd1c149ca0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 28ddedd47438cf00d9ebd2bd1c149ca0 2023-10-01 19:02:38,126 INFO [StoreOpener-11ece1e1674a15d47e59e77a63687165-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 11ece1e1674a15d47e59e77a63687165 2023-10-01 19:02:38,127 DEBUG [StoreOpener-28ddedd47438cf00d9ebd2bd1c149ca0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/28ddedd47438cf00d9ebd2bd1c149ca0/cf 2023-10-01 19:02:38,127 DEBUG [StoreOpener-28ddedd47438cf00d9ebd2bd1c149ca0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/28ddedd47438cf00d9ebd2bd1c149ca0/cf 2023-10-01 19:02:38,127 DEBUG [StoreOpener-11ece1e1674a15d47e59e77a63687165-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/11ece1e1674a15d47e59e77a63687165/cf 2023-10-01 19:02:38,127 DEBUG [StoreOpener-11ece1e1674a15d47e59e77a63687165-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/11ece1e1674a15d47e59e77a63687165/cf 2023-10-01 19:02:38,128 INFO [StoreOpener-28ddedd47438cf00d9ebd2bd1c149ca0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 28ddedd47438cf00d9ebd2bd1c149ca0 columnFamilyName cf 2023-10-01 19:02:38,128 INFO [StoreOpener-11ece1e1674a15d47e59e77a63687165-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 11ece1e1674a15d47e59e77a63687165 columnFamilyName cf 2023-10-01 19:02:38,128 INFO [StoreOpener-28ddedd47438cf00d9ebd2bd1c149ca0-1] regionserver.HStore(310): Store=28ddedd47438cf00d9ebd2bd1c149ca0/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 19:02:38,128 INFO [StoreOpener-11ece1e1674a15d47e59e77a63687165-1] regionserver.HStore(310): Store=11ece1e1674a15d47e59e77a63687165/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 19:02:38,129 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/28ddedd47438cf00d9ebd2bd1c149ca0 2023-10-01 19:02:38,129 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/11ece1e1674a15d47e59e77a63687165 2023-10-01 19:02:38,129 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/28ddedd47438cf00d9ebd2bd1c149ca0 2023-10-01 19:02:38,129 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/11ece1e1674a15d47e59e77a63687165 2023-10-01 19:02:38,132 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 28ddedd47438cf00d9ebd2bd1c149ca0 2023-10-01 19:02:38,132 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 11ece1e1674a15d47e59e77a63687165 2023-10-01 19:02:38,134 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/11ece1e1674a15d47e59e77a63687165/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-01 19:02:38,134 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/28ddedd47438cf00d9ebd2bd1c149ca0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-01 19:02:38,134 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 11ece1e1674a15d47e59e77a63687165; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71305832, jitterRate=0.06253969669342041}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-01 19:02:38,135 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 11ece1e1674a15d47e59e77a63687165: 2023-10-01 19:02:38,135 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 28ddedd47438cf00d9ebd2bd1c149ca0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69257980, jitterRate=0.0320243239402771}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-01 19:02:38,135 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 28ddedd47438cf00d9ebd2bd1c149ca0: 2023-10-01 19:02:38,135 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1696186957772.11ece1e1674a15d47e59e77a63687165., pid=69, masterSystemTime=1696186958120 2023-10-01 19:02:38,135 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1696186957772.28ddedd47438cf00d9ebd2bd1c149ca0., pid=70, masterSystemTime=1696186958120 2023-10-01 19:02:38,137 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1696186957772.11ece1e1674a15d47e59e77a63687165. 2023-10-01 19:02:38,137 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1696186957772.11ece1e1674a15d47e59e77a63687165. 2023-10-01 19:02:38,138 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=11ece1e1674a15d47e59e77a63687165, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:38,138 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1696186957772.28ddedd47438cf00d9ebd2bd1c149ca0. 2023-10-01 19:02:38,138 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696186957772.11ece1e1674a15d47e59e77a63687165.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696186958138"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696186958138"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696186958138"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696186958138"}]},"ts":"1696186958138"} 2023-10-01 19:02:38,138 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1696186957772.28ddedd47438cf00d9ebd2bd1c149ca0. 2023-10-01 19:02:38,139 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=28ddedd47438cf00d9ebd2bd1c149ca0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:38,139 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696186957772.28ddedd47438cf00d9ebd2bd1c149ca0.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696186958139"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696186958139"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696186958139"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696186958139"}]},"ts":"1696186958139"} 2023-10-01 19:02:38,141 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=69, resume processing ppid=67 2023-10-01 19:02:38,141 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 11ece1e1674a15d47e59e77a63687165, server=jenkins-hbase4.apache.org,46609,1696186884566 in 172 msec 2023-10-01 19:02:38,142 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=70, resume processing ppid=68 2023-10-01 19:02:38,142 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=70, ppid=68, state=SUCCESS; OpenRegionProcedure 28ddedd47438cf00d9ebd2bd1c149ca0, server=jenkins-hbase4.apache.org,36507,1696186884612 in 171 msec 2023-10-01 19:02:38,143 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=11ece1e1674a15d47e59e77a63687165, ASSIGN in 331 msec 2023-10-01 19:02:38,144 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=68, resume processing ppid=66 2023-10-01 19:02:38,144 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=28ddedd47438cf00d9ebd2bd1c149ca0, ASSIGN in 332 msec 2023-10-01 19:02:38,144 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-01 19:02:38,144 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696186958144"}]},"ts":"1696186958144"} 2023-10-01 19:02:38,146 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-10-01 19:02:38,148 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-10-01 19:02:38,148 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-10-01 19:02:38,150 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36507] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-10-01 19:02:38,151 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 19:02:38,151 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 19:02:38,151 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 19:02:38,151 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 19:02:38,152 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-01 19:02:38,152 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-01 19:02:38,153 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-01 19:02:38,153 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-01 19:02:38,153 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-10-01 19:02:38,153 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-10-01 19:02:38,153 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-10-01 19:02:38,153 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-10-01 19:02:38,153 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 379 msec 2023-10-01 19:02:38,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-10-01 19:02:38,380 INFO [Listener at jenkins-hbase4.apache.org/36885] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-10-01 19:02:38,400 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions 11ece1e1674a15d47e59e77a63687165, 28ddedd47438cf00d9ebd2bd1c149ca0 2023-10-01 19:02:38,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] procedure2.ProcedureExecutor(1028): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[11ece1e1674a15d47e59e77a63687165, 28ddedd47438cf00d9ebd2bd1c149ca0], force=true 2023-10-01 19:02:38,410 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[11ece1e1674a15d47e59e77a63687165, 28ddedd47438cf00d9ebd2bd1c149ca0], force=true 2023-10-01 19:02:38,410 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[11ece1e1674a15d47e59e77a63687165, 28ddedd47438cf00d9ebd2bd1c149ca0], force=true 2023-10-01 19:02:38,410 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[11ece1e1674a15d47e59e77a63687165, 28ddedd47438cf00d9ebd2bd1c149ca0], force=true 2023-10-01 19:02:38,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-01 19:02:38,431 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=11ece1e1674a15d47e59e77a63687165, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=28ddedd47438cf00d9ebd2bd1c149ca0, UNASSIGN}] 2023-10-01 19:02:38,433 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=11ece1e1674a15d47e59e77a63687165, UNASSIGN 2023-10-01 19:02:38,433 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=28ddedd47438cf00d9ebd2bd1c149ca0, UNASSIGN 2023-10-01 19:02:38,433 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=11ece1e1674a15d47e59e77a63687165, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:38,433 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=28ddedd47438cf00d9ebd2bd1c149ca0, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:38,433 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696186957772.11ece1e1674a15d47e59e77a63687165.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696186958433"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696186958433"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696186958433"}]},"ts":"1696186958433"} 2023-10-01 19:02:38,433 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696186957772.28ddedd47438cf00d9ebd2bd1c149ca0.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696186958433"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696186958433"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696186958433"}]},"ts":"1696186958433"} 2023-10-01 19:02:38,435 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure 11ece1e1674a15d47e59e77a63687165, server=jenkins-hbase4.apache.org,46609,1696186884566}] 2023-10-01 19:02:38,436 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure 28ddedd47438cf00d9ebd2bd1c149ca0, server=jenkins-hbase4.apache.org,36507,1696186884612}] 2023-10-01 19:02:38,479 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-10-01 19:02:38,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-01 19:02:38,587 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 11ece1e1674a15d47e59e77a63687165 2023-10-01 19:02:38,588 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 11ece1e1674a15d47e59e77a63687165, disabling compactions & flushes 2023-10-01 19:02:38,588 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1696186957772.11ece1e1674a15d47e59e77a63687165. 2023-10-01 19:02:38,588 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696186957772.11ece1e1674a15d47e59e77a63687165. 2023-10-01 19:02:38,588 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696186957772.11ece1e1674a15d47e59e77a63687165. after waiting 0 ms 2023-10-01 19:02:38,588 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1696186957772.11ece1e1674a15d47e59e77a63687165. 2023-10-01 19:02:38,588 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 11ece1e1674a15d47e59e77a63687165 1/1 column families, dataSize=24 B heapSize=352 B 2023-10-01 19:02:38,589 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 28ddedd47438cf00d9ebd2bd1c149ca0 2023-10-01 19:02:38,590 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 28ddedd47438cf00d9ebd2bd1c149ca0, disabling compactions & flushes 2023-10-01 19:02:38,590 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1696186957772.28ddedd47438cf00d9ebd2bd1c149ca0. 2023-10-01 19:02:38,590 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1696186957772.28ddedd47438cf00d9ebd2bd1c149ca0. 2023-10-01 19:02:38,590 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1696186957772.28ddedd47438cf00d9ebd2bd1c149ca0. after waiting 0 ms 2023-10-01 19:02:38,590 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1696186957772.28ddedd47438cf00d9ebd2bd1c149ca0. 2023-10-01 19:02:38,590 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 28ddedd47438cf00d9ebd2bd1c149ca0 1/1 column families, dataSize=24 B heapSize=352 B 2023-10-01 19:02:38,600 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/11ece1e1674a15d47e59e77a63687165/.tmp/cf/140cd9d6b778448392e99729d7a867f6 2023-10-01 19:02:38,600 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/28ddedd47438cf00d9ebd2bd1c149ca0/.tmp/cf/c181f0da2dc14c2380738849ad0386ae 2023-10-01 19:02:38,605 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/11ece1e1674a15d47e59e77a63687165/.tmp/cf/140cd9d6b778448392e99729d7a867f6 as hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/11ece1e1674a15d47e59e77a63687165/cf/140cd9d6b778448392e99729d7a867f6 2023-10-01 19:02:38,606 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/28ddedd47438cf00d9ebd2bd1c149ca0/.tmp/cf/c181f0da2dc14c2380738849ad0386ae as hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/28ddedd47438cf00d9ebd2bd1c149ca0/cf/c181f0da2dc14c2380738849ad0386ae 2023-10-01 19:02:38,610 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/11ece1e1674a15d47e59e77a63687165/cf/140cd9d6b778448392e99729d7a867f6, entries=1, sequenceid=5, filesize=4.7 K 2023-10-01 19:02:38,611 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 11ece1e1674a15d47e59e77a63687165 in 23ms, sequenceid=5, compaction requested=false 2023-10-01 19:02:38,613 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/28ddedd47438cf00d9ebd2bd1c149ca0/cf/c181f0da2dc14c2380738849ad0386ae, entries=1, sequenceid=5, filesize=4.7 K 2023-10-01 19:02:38,616 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 28ddedd47438cf00d9ebd2bd1c149ca0 in 26ms, sequenceid=5, compaction requested=false 2023-10-01 19:02:38,621 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/11ece1e1674a15d47e59e77a63687165/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-10-01 19:02:38,621 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 19:02:38,621 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/28ddedd47438cf00d9ebd2bd1c149ca0/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-10-01 19:02:38,622 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1696186957772.11ece1e1674a15d47e59e77a63687165. 2023-10-01 19:02:38,622 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 11ece1e1674a15d47e59e77a63687165: 2023-10-01 19:02:38,622 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 19:02:38,622 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1696186957772.28ddedd47438cf00d9ebd2bd1c149ca0. 2023-10-01 19:02:38,622 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 28ddedd47438cf00d9ebd2bd1c149ca0: 2023-10-01 19:02:38,623 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 11ece1e1674a15d47e59e77a63687165 2023-10-01 19:02:38,623 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=11ece1e1674a15d47e59e77a63687165, regionState=CLOSED 2023-10-01 19:02:38,624 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696186957772.11ece1e1674a15d47e59e77a63687165.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696186958623"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696186958623"}]},"ts":"1696186958623"} 2023-10-01 19:02:38,624 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 28ddedd47438cf00d9ebd2bd1c149ca0 2023-10-01 19:02:38,624 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=28ddedd47438cf00d9ebd2bd1c149ca0, regionState=CLOSED 2023-10-01 19:02:38,624 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696186957772.28ddedd47438cf00d9ebd2bd1c149ca0.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696186958624"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696186958624"}]},"ts":"1696186958624"} 2023-10-01 19:02:38,627 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=74, resume processing ppid=72 2023-10-01 19:02:38,627 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure 11ece1e1674a15d47e59e77a63687165, server=jenkins-hbase4.apache.org,46609,1696186884566 in 190 msec 2023-10-01 19:02:38,628 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=75, resume processing ppid=73 2023-10-01 19:02:38,628 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure 28ddedd47438cf00d9ebd2bd1c149ca0, server=jenkins-hbase4.apache.org,36507,1696186884612 in 191 msec 2023-10-01 19:02:38,628 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=11ece1e1674a15d47e59e77a63687165, UNASSIGN in 199 msec 2023-10-01 19:02:38,630 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=73, resume processing ppid=71 2023-10-01 19:02:38,630 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=28ddedd47438cf00d9ebd2bd1c149ca0, UNASSIGN in 197 msec 2023-10-01 19:02:38,671 DEBUG [PEWorker-3] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a747187694f676404473d29d09cac06d/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-10-01 19:02:38,673 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696186957772.11ece1e1674a15d47e59e77a63687165.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-10-01 19:02:38,673 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696186957772.28ddedd47438cf00d9ebd2bd1c149ca0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-10-01 19:02:38,673 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696186957773.a747187694f676404473d29d09cac06d.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-10-01 19:02:38,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-01 19:02:38,722 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a747187694f676404473d29d09cac06d, ASSIGN}] 2023-10-01 19:02:38,723 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a747187694f676404473d29d09cac06d, ASSIGN 2023-10-01 19:02:38,724 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a747187694f676404473d29d09cac06d, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,46609,1696186884566; forceNewPlan=false, retain=false 2023-10-01 19:02:38,874 INFO [jenkins-hbase4:42819] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-10-01 19:02:38,876 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=a747187694f676404473d29d09cac06d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:38,876 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696186957773.a747187694f676404473d29d09cac06d.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1696186958876"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696186958876"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696186958876"}]},"ts":"1696186958876"} 2023-10-01 19:02:38,878 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure a747187694f676404473d29d09cac06d, server=jenkins-hbase4.apache.org,46609,1696186884566}] 2023-10-01 19:02:39,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-01 19:02:39,033 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1696186957773.a747187694f676404473d29d09cac06d. 2023-10-01 19:02:39,033 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a747187694f676404473d29d09cac06d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696186957773.a747187694f676404473d29d09cac06d.', STARTKEY => '', ENDKEY => ''} 2023-10-01 19:02:39,033 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1696186957773.a747187694f676404473d29d09cac06d. service=AccessControlService 2023-10-01 19:02:39,033 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 19:02:39,033 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 a747187694f676404473d29d09cac06d 2023-10-01 19:02:39,034 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1696186957773.a747187694f676404473d29d09cac06d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 19:02:39,034 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a747187694f676404473d29d09cac06d 2023-10-01 19:02:39,034 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a747187694f676404473d29d09cac06d 2023-10-01 19:02:39,034 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a747187694f676404473d29d09cac06d/.regioninfo 2023-10-01 19:02:39,044 INFO [StoreOpener-a747187694f676404473d29d09cac06d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a747187694f676404473d29d09cac06d 2023-10-01 19:02:39,045 DEBUG [StoreOpener-a747187694f676404473d29d09cac06d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a747187694f676404473d29d09cac06d/cf 2023-10-01 19:02:39,045 DEBUG [StoreOpener-a747187694f676404473d29d09cac06d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a747187694f676404473d29d09cac06d/cf 2023-10-01 19:02:39,045 INFO [StoreOpener-a747187694f676404473d29d09cac06d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a747187694f676404473d29d09cac06d columnFamilyName cf 2023-10-01 19:02:39,072 DEBUG [StoreOpener-a747187694f676404473d29d09cac06d-1] regionserver.HStore(539): loaded hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a747187694f676404473d29d09cac06d/cf/140cd9d6b778448392e99729d7a867f6.11ece1e1674a15d47e59e77a63687165->hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/11ece1e1674a15d47e59e77a63687165/cf/140cd9d6b778448392e99729d7a867f6-top 2023-10-01 19:02:39,077 DEBUG [StoreOpener-a747187694f676404473d29d09cac06d-1] regionserver.HStore(539): loaded hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a747187694f676404473d29d09cac06d/cf/c181f0da2dc14c2380738849ad0386ae.28ddedd47438cf00d9ebd2bd1c149ca0->hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/28ddedd47438cf00d9ebd2bd1c149ca0/cf/c181f0da2dc14c2380738849ad0386ae-top 2023-10-01 19:02:39,078 INFO [StoreOpener-a747187694f676404473d29d09cac06d-1] regionserver.HStore(310): Store=a747187694f676404473d29d09cac06d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 19:02:39,079 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a747187694f676404473d29d09cac06d 2023-10-01 19:02:39,080 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a747187694f676404473d29d09cac06d 2023-10-01 19:02:39,083 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a747187694f676404473d29d09cac06d 2023-10-01 19:02:39,084 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a747187694f676404473d29d09cac06d; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75363183, jitterRate=0.12299893796443939}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-01 19:02:39,084 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a747187694f676404473d29d09cac06d: 2023-10-01 19:02:39,084 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1696186957773.a747187694f676404473d29d09cac06d., pid=77, masterSystemTime=1696186959030 2023-10-01 19:02:39,085 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1696186957773.a747187694f676404473d29d09cac06d.,because compaction is disabled. 2023-10-01 19:02:39,086 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1696186957773.a747187694f676404473d29d09cac06d. 2023-10-01 19:02:39,086 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1696186957773.a747187694f676404473d29d09cac06d. 2023-10-01 19:02:39,087 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=a747187694f676404473d29d09cac06d, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:39,087 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696186957773.a747187694f676404473d29d09cac06d.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1696186959087"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696186959087"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696186959087"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696186959087"}]},"ts":"1696186959087"} 2023-10-01 19:02:39,090 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=77, resume processing ppid=76 2023-10-01 19:02:39,090 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure a747187694f676404473d29d09cac06d, server=jenkins-hbase4.apache.org,46609,1696186884566 in 210 msec 2023-10-01 19:02:39,091 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=76, resume processing ppid=71 2023-10-01 19:02:39,091 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a747187694f676404473d29d09cac06d, ASSIGN in 368 msec 2023-10-01 19:02:39,092 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[11ece1e1674a15d47e59e77a63687165, 28ddedd47438cf00d9ebd2bd1c149ca0], force=true in 688 msec 2023-10-01 19:02:39,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-01 19:02:39,517 INFO [Listener at jenkins-hbase4.apache.org/36885] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-10-01 19:02:39,518 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-10-01 19:02:39,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696186959518 (current time:1696186959518). 2023-10-01 19:02:39,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-01 19:02:39,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(139): Connect 0x06a739a3 to 127.0.0.1:55462 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 19:02:39,526 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@ae6e214, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 19:02:39,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 19:02:39,530 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44458, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 19:02:39,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x06a739a3 to 127.0.0.1:55462 2023-10-01 19:02:39,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 19:02:39,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(139): Connect 0x24b4643a to 127.0.0.1:55462 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 19:02:39,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1b612b2e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 19:02:39,538 DEBUG [hconnection-0x262a8c14-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 19:02:39,540 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44466, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 19:02:39,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 19:02:39,546 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59130, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 19:02:39,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x24b4643a to 127.0.0.1:55462 2023-10-01 19:02:39,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 19:02:39,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-10-01 19:02:39,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-01 19:02:39,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-10-01 19:02:39,550 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot, current working dir path: hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-01 19:02:39,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] procedure2.ProcedureExecutor(1028): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-10-01 19:02:39,552 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-10-01 19:02:39,553 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1696187559553 2023-10-01 19:02:39,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-10-01 19:02:39,553 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 19:02:39,556 DEBUG [Listener at jenkins-hbase4.apache.org/36885] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-01 19:02:39,556 DEBUG [Listener at jenkins-hbase4.apache.org/36885] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-01 19:02:39,557 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-10-01 19:02:39,557 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-10-01 19:02:39,558 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 6 msec 2023-10-01 19:02:39,559 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-10-01 19:02:39,559 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1696187559559 2023-10-01 19:02:39,567 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 19:02:39,567 INFO [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-10-01 19:02:39,567 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 19:02:39,568 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-10-01 19:02:39,568 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-10-01 19:02:39,569 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 19:02:39,569 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 19:02:39,570 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 19:02:39,570 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 19:02:39,570 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 19:02:39,570 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 19:02:39,570 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:39,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 19:02:39,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 19:02:39,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 19:02:39,570 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 19:02:39,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 19:02:39,571 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:39,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 19:02:39,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 19:02:39,571 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-01 19:02:39,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 19:02:39,571 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 19:02:39,572 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 19:02:39,571 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 19:02:39,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-10-01 19:02:39,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-10-01 19:02:39,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 19:02:39,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-10-01 19:02:39,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 19:02:39,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 19:02:39,572 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-10-01 19:02:39,572 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-10-01 19:02:39,572 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-10-01 19:02:39,572 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 19:02:39,573 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-10-01 19:02:39,573 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 19:02:39,573 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 19:02:39,574 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 19:02:39,574 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-10-01 19:02:39,574 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 19:02:39,574 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-10-01 19:02:39,575 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-10-01 19:02:39,575 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-10-01 19:02:39,575 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44933,1696186884649' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-10-01 19:02:39,575 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-10-01 19:02:39,575 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46609,1696186884566' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-10-01 19:02:39,574 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-10-01 19:02:39,575 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 19:02:39,576 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-10-01 19:02:39,576 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-10-01 19:02:39,576 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36507,1696186884612' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-10-01 19:02:39,577 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:39,577 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 19:02:39,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:39,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 19:02:39,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 19:02:39,578 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 19:02:39,578 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 19:02:39,578 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 19:02:39,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 19:02:39,578 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 19:02:39,578 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 19:02:39,578 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 19:02:39,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 19:02:39,578 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 19:02:39,578 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 19:02:39,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 19:02:39,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:39,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:39,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:39,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 19:02:39,580 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46609,1696186884566' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-10-01 19:02:39,580 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7035e8ed[Count = 0] remaining members to acquire global barrier 2023-10-01 19:02:39,580 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-10-01 19:02:39,580 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 19:02:39,582 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 19:02:39,582 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 19:02:39,582 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 19:02:39,582 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 19:02:39,582 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 19:02:39,582 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:39,582 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-01 19:02:39,582 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 19:02:39,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 19:02:39,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 19:02:39,582 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-10-01 19:02:39,582 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-10-01 19:02:39,582 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-10-01 19:02:39,582 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,36507,1696186884612' in zk 2023-10-01 19:02:39,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 19:02:39,583 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-10-01 19:02:39,583 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-10-01 19:02:39,583 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,44933,1696186884649' in zk 2023-10-01 19:02:39,584 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-10-01 19:02:39,584 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 19:02:39,584 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-10-01 19:02:39,585 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-10-01 19:02:39,585 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 19:02:39,585 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-10-01 19:02:39,589 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 19:02:39,589 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 19:02:39,589 DEBUG [rs(jenkins-hbase4.apache.org,46609,1696186884566)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1696186957773.a747187694f676404473d29d09cac06d. 2023-10-01 19:02:39,589 DEBUG [rs(jenkins-hbase4.apache.org,46609,1696186884566)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1696186957773.a747187694f676404473d29d09cac06d. started... 2023-10-01 19:02:39,590 DEBUG [rs(jenkins-hbase4.apache.org,46609,1696186884566)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a747187694f676404473d29d09cac06d: 2023-10-01 19:02:39,590 DEBUG [rs(jenkins-hbase4.apache.org,46609,1696186884566)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696186957773.a747187694f676404473d29d09cac06d.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 19:02:39,590 DEBUG [rs(jenkins-hbase4.apache.org,46609,1696186884566)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 19:02:39,590 DEBUG [rs(jenkins-hbase4.apache.org,46609,1696186884566)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a747187694f676404473d29d09cac06d/cf/140cd9d6b778448392e99729d7a867f6.11ece1e1674a15d47e59e77a63687165->hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/11ece1e1674a15d47e59e77a63687165/cf/140cd9d6b778448392e99729d7a867f6-top, hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a747187694f676404473d29d09cac06d/cf/c181f0da2dc14c2380738849ad0386ae.28ddedd47438cf00d9ebd2bd1c149ca0->hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/28ddedd47438cf00d9ebd2bd1c149ca0/cf/c181f0da2dc14c2380738849ad0386ae-top] hfiles 2023-10-01 19:02:39,590 DEBUG [rs(jenkins-hbase4.apache.org,46609,1696186884566)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a747187694f676404473d29d09cac06d/cf/140cd9d6b778448392e99729d7a867f6.11ece1e1674a15d47e59e77a63687165 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 19:02:39,591 DEBUG [rs(jenkins-hbase4.apache.org,46609,1696186884566)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a747187694f676404473d29d09cac06d/cf/c181f0da2dc14c2380738849ad0386ae.28ddedd47438cf00d9ebd2bd1c149ca0 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 19:02:39,597 DEBUG [rs(jenkins-hbase4.apache.org,46609,1696186884566)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1696186957773.a747187694f676404473d29d09cac06d. completed. 2023-10-01 19:02:39,597 DEBUG [rs(jenkins-hbase4.apache.org,46609,1696186884566)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1696186957773.a747187694f676404473d29d09cac06d. 2023-10-01 19:02:39,597 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 19:02:39,597 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 19:02:39,598 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:39,598 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-10-01 19:02:39,598 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,46609,1696186884566' in zk 2023-10-01 19:02:39,602 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-10-01 19:02:39,602 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:39,602 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 19:02:39,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:39,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 19:02:39,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 19:02:39,603 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-10-01 19:02:39,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 19:02:39,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 19:02:39,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 19:02:39,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:39,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:39,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:39,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 19:02:39,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 19:02:39,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:39,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:39,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:39,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,46609,1696186884566': 2023-10-01 19:02:39,606 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46609,1696186884566' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-10-01 19:02:39,606 INFO [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-10-01 19:02:39,606 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-01 19:02:39,606 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-01 19:02:39,606 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 19:02:39,606 INFO [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-01 19:02:39,607 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 19:02:39,607 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 19:02:39,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 19:02:39,607 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 19:02:39,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 19:02:39,607 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 19:02:39,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 19:02:39,607 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 19:02:39,607 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 19:02:39,607 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 19:02:39,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 19:02:39,608 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 19:02:39,607 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 19:02:39,608 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:39,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 19:02:39,608 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 19:02:39,608 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 19:02:39,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 19:02:39,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 19:02:39,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 19:02:39,608 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:39,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 19:02:39,609 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 19:02:39,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 19:02:39,609 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 19:02:39,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 19:02:39,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 19:02:39,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 19:02:39,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 19:02:39,613 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:39,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 19:02:39,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 19:02:39,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:39,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:39,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:39,614 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:39,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 19:02:39,615 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:39,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 19:02:39,615 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:39,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:39,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:39,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:39,618 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:39,618 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 19:02:39,618 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 19:02:39,618 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 19:02:39,618 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 19:02:39,618 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 19:02:39,618 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 19:02:39,618 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 19:02:39,618 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 19:02:39,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 19:02:39,618 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:39,618 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 19:02:39,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 19:02:39,618 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 19:02:39,618 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 19:02:39,618 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 19:02:39,618 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 19:02:39,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 19:02:39,618 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 19:02:39,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 19:02:39,618 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 19:02:39,618 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:39,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 19:02:39,619 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 19:02:39,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 19:02:39,619 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 19:02:39,619 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:39,619 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 19:02:39,619 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 19:02:39,619 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:39,619 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:39,619 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 19:02:39,619 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 19:02:39,642 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 19:02:39,643 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-10-01 19:02:39,643 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 19:02:39,644 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 19:02:39,644 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1696186959553Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1696186959618 (+65 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1696186959618Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1696186959621 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1696186959635 (+14 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1696186959643 (+8 ms) 2023-10-01 19:02:39,646 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-10-01 19:02:39,647 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 90 msec 2023-10-01 19:02:39,656 DEBUG [Listener at jenkins-hbase4.apache.org/36885] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 19:02:39,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-10-01 19:02:39,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-01 19:02:39,658 INFO [Listener at jenkins-hbase4.apache.org/36885] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/export-test/export-1696186959658 2023-10-01 19:02:39,658 INFO [Listener at jenkins-hbase4.apache.org/36885] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:38933, tgtDir=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/export-test/export-1696186959658, rawTgtDir=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/export-test/export-1696186959658, srcFsUri=hdfs://localhost:38933, srcDir=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399 2023-10-01 19:02:39,680 DEBUG [Listener at jenkins-hbase4.apache.org/36885] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:38933, inputRoot=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399 2023-10-01 19:02:39,680 DEBUG [Listener at jenkins-hbase4.apache.org/36885] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1013496783_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/export-test/export-1696186959658, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/export-test/export-1696186959658/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 19:02:39,680 INFO [Listener at jenkins-hbase4.apache.org/36885] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:38933, inputRoot=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399, snapshotDir=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-10-01 19:02:39,688 INFO [Listener at jenkins-hbase4.apache.org/36885] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/export-test/export-1696186959658/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 19:02:39,704 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-01 19:02:39,705 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-01 19:02:39,706 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-01 19:02:39,706 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-01 19:02:40,275 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696186890860_0004_000001 (auth:SIMPLE) 2023-10-01 19:02:40,605 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba/hadoop-1772006191120719710.jar 2023-10-01 19:02:40,605 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-01 19:02:40,606 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-01 19:02:40,672 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba/hadoop-6603194253531553698.jar 2023-10-01 19:02:40,672 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-01 19:02:40,673 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-01 19:02:40,673 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-01 19:02:40,673 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-01 19:02:40,674 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-01 19:02:40,674 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-01 19:02:40,674 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-01 19:02:40,675 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-01 19:02:40,675 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-01 19:02:40,675 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-01 19:02:40,676 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-01 19:02:40,676 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-01 19:02:40,677 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-01 19:02:40,677 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-01 19:02:40,677 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-01 19:02:40,678 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-01 19:02:40,678 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 19:02:40,679 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 19:02:40,679 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 19:02:40,679 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 19:02:40,680 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 19:02:40,680 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 19:02:40,681 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 19:02:41,085 WARN [Listener at jenkins-hbase4.apache.org/36885] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-01 19:02:41,087 INFO [Listener at jenkins-hbase4.apache.org/36885] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-10-01 19:02:41,089 DEBUG [Listener at jenkins-hbase4.apache.org/36885] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-10-01 19:02:41,142 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-01 19:02:41,142 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-01 19:02:41,241 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696186890860_0005_000001 (auth:SIMPLE) 2023-10-01 19:02:41,364 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-01 19:02:45,008 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696186890860_0005_000001 (auth:SIMPLE) 2023-10-01 19:02:47,235 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696186890860_0005_000001 (auth:SIMPLE) 2023-10-01 19:02:49,571 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696186890860_0005_000001 (auth:SIMPLE) 2023-10-01 19:02:51,244 INFO [Listener at jenkins-hbase4.apache.org/36885] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-01 19:02:51,247 INFO [Listener at jenkins-hbase4.apache.org/36885] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-01 19:02:51,256 INFO [Listener at jenkins-hbase4.apache.org/36885] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 19:02:51,257 INFO [Listener at jenkins-hbase4.apache.org/36885] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-01 19:02:51,257 INFO [Listener at jenkins-hbase4.apache.org/36885] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-01 19:02:51,257 DEBUG [Listener at jenkins-hbase4.apache.org/36885] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-628947520_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 19:02:51,258 DEBUG [Listener at jenkins-hbase4.apache.org/36885] snapshot.TestExportSnapshot(367): hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-10-01 19:02:51,258 DEBUG [Listener at jenkins-hbase4.apache.org/36885] snapshot.TestExportSnapshot(367): hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-10-01 19:02:51,258 DEBUG [Listener at jenkins-hbase4.apache.org/36885] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-628947520_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/export-test/export-1696186959658/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/export-test/export-1696186959658/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 19:02:51,258 DEBUG [Listener at jenkins-hbase4.apache.org/36885] snapshot.TestExportSnapshot(367): hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/export-test/export-1696186959658/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-10-01 19:02:51,258 DEBUG [Listener at jenkins-hbase4.apache.org/36885] snapshot.TestExportSnapshot(367): hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/export-test/export-1696186959658/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-10-01 19:02:51,264 INFO [Listener at jenkins-hbase4.apache.org/36885] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 19:02:51,265 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 19:02:51,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] procedure2.ProcedureExecutor(1028): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 19:02:51,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-10-01 19:02:51,269 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696186971269"}]},"ts":"1696186971269"} 2023-10-01 19:02:51,270 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-10-01 19:02:51,272 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-10-01 19:02:51,272 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a747187694f676404473d29d09cac06d, UNASSIGN}] 2023-10-01 19:02:51,274 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a747187694f676404473d29d09cac06d, UNASSIGN 2023-10-01 19:02:51,275 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=a747187694f676404473d29d09cac06d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:51,275 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696186957773.a747187694f676404473d29d09cac06d.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1696186971275"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696186971275"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696186971275"}]},"ts":"1696186971275"} 2023-10-01 19:02:51,276 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure a747187694f676404473d29d09cac06d, server=jenkins-hbase4.apache.org,46609,1696186884566}] 2023-10-01 19:02:51,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-10-01 19:02:51,428 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close a747187694f676404473d29d09cac06d 2023-10-01 19:02:51,428 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a747187694f676404473d29d09cac06d, disabling compactions & flushes 2023-10-01 19:02:51,428 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1696186957773.a747187694f676404473d29d09cac06d. 2023-10-01 19:02:51,428 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696186957773.a747187694f676404473d29d09cac06d. 2023-10-01 19:02:51,428 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696186957773.a747187694f676404473d29d09cac06d. after waiting 0 ms 2023-10-01 19:02:51,428 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1696186957773.a747187694f676404473d29d09cac06d. 2023-10-01 19:02:51,439 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a747187694f676404473d29d09cac06d/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-10-01 19:02:51,439 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 19:02:51,440 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1696186957773.a747187694f676404473d29d09cac06d. 2023-10-01 19:02:51,440 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a747187694f676404473d29d09cac06d: 2023-10-01 19:02:51,441 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed a747187694f676404473d29d09cac06d 2023-10-01 19:02:51,442 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=a747187694f676404473d29d09cac06d, regionState=CLOSED 2023-10-01 19:02:51,442 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696186957773.a747187694f676404473d29d09cac06d.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1696186971442"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696186971442"}]},"ts":"1696186971442"} 2023-10-01 19:02:51,445 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=82, resume processing ppid=81 2023-10-01 19:02:51,445 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure a747187694f676404473d29d09cac06d, server=jenkins-hbase4.apache.org,46609,1696186884566 in 167 msec 2023-10-01 19:02:51,446 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=81, resume processing ppid=80 2023-10-01 19:02:51,446 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a747187694f676404473d29d09cac06d, UNASSIGN in 173 msec 2023-10-01 19:02:51,447 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696186971447"}]},"ts":"1696186971447"} 2023-10-01 19:02:51,448 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-10-01 19:02:51,451 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-10-01 19:02:51,452 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 186 msec 2023-10-01 19:02:51,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-10-01 19:02:51,571 INFO [Listener at jenkins-hbase4.apache.org/36885] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-10-01 19:02:51,571 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 19:02:51,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] procedure2.ProcedureExecutor(1028): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 19:02:51,574 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 19:02:51,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 19:02:51,575 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 19:02:51,576 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36507] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 19:02:51,579 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 19:02:51,579 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 19:02:51,579 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 19:02:51,579 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 19:02:51,580 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/28ddedd47438cf00d9ebd2bd1c149ca0 2023-10-01 19:02:51,580 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/11ece1e1674a15d47e59e77a63687165 2023-10-01 19:02:51,580 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a747187694f676404473d29d09cac06d 2023-10-01 19:02:51,580 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-10-01 19:02:51,580 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-10-01 19:02:51,580 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-10-01 19:02:51,581 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 19:02:51,581 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 19:02:51,581 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 19:02:51,581 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 19:02:51,581 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 19:02:51,581 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 19:02:51,581 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 19:02:51,581 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-10-01 19:02:51,581 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-01 19:02:51,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-10-01 19:02:51,582 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-01 19:02:51,582 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-01 19:02:51,582 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-01 19:02:51,582 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/28ddedd47438cf00d9ebd2bd1c149ca0/cf, FileablePath, hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/28ddedd47438cf00d9ebd2bd1c149ca0/recovered.edits] 2023-10-01 19:02:51,582 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-01 19:02:51,582 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a747187694f676404473d29d09cac06d/cf, FileablePath, hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a747187694f676404473d29d09cac06d/recovered.edits] 2023-10-01 19:02:51,583 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/11ece1e1674a15d47e59e77a63687165/cf, FileablePath, hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/11ece1e1674a15d47e59e77a63687165/recovered.edits] 2023-10-01 19:02:51,587 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a747187694f676404473d29d09cac06d/cf/140cd9d6b778448392e99729d7a867f6.11ece1e1674a15d47e59e77a63687165 to hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a747187694f676404473d29d09cac06d/cf/140cd9d6b778448392e99729d7a867f6.11ece1e1674a15d47e59e77a63687165 2023-10-01 19:02:51,587 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/28ddedd47438cf00d9ebd2bd1c149ca0/cf/c181f0da2dc14c2380738849ad0386ae to hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/28ddedd47438cf00d9ebd2bd1c149ca0/cf/c181f0da2dc14c2380738849ad0386ae 2023-10-01 19:02:51,587 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/11ece1e1674a15d47e59e77a63687165/cf/140cd9d6b778448392e99729d7a867f6 to hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/11ece1e1674a15d47e59e77a63687165/cf/140cd9d6b778448392e99729d7a867f6 2023-10-01 19:02:51,589 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a747187694f676404473d29d09cac06d/cf/c181f0da2dc14c2380738849ad0386ae.28ddedd47438cf00d9ebd2bd1c149ca0 to hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a747187694f676404473d29d09cac06d/cf/c181f0da2dc14c2380738849ad0386ae.28ddedd47438cf00d9ebd2bd1c149ca0 2023-10-01 19:02:51,591 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/28ddedd47438cf00d9ebd2bd1c149ca0/recovered.edits/8.seqid to hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/28ddedd47438cf00d9ebd2bd1c149ca0/recovered.edits/8.seqid 2023-10-01 19:02:51,592 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/11ece1e1674a15d47e59e77a63687165/recovered.edits/8.seqid to hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/11ece1e1674a15d47e59e77a63687165/recovered.edits/8.seqid 2023-10-01 19:02:51,592 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/28ddedd47438cf00d9ebd2bd1c149ca0 2023-10-01 19:02:51,592 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/11ece1e1674a15d47e59e77a63687165 2023-10-01 19:02:51,592 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a747187694f676404473d29d09cac06d/recovered.edits/12.seqid to hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a747187694f676404473d29d09cac06d/recovered.edits/12.seqid 2023-10-01 19:02:51,593 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a747187694f676404473d29d09cac06d 2023-10-01 19:02:51,593 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-10-01 19:02:51,595 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 19:02:51,597 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-10-01 19:02:51,599 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-10-01 19:02:51,600 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 19:02:51,600 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-10-01 19:02:51,600 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696186957773.a747187694f676404473d29d09cac06d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696186971600"}]},"ts":"9223372036854775807"} 2023-10-01 19:02:51,601 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-10-01 19:02:51,601 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => a747187694f676404473d29d09cac06d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696186957773.a747187694f676404473d29d09cac06d.', STARTKEY => '', ENDKEY => ''}] 2023-10-01 19:02:51,601 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-10-01 19:02:51,601 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696186971601"}]},"ts":"9223372036854775807"} 2023-10-01 19:02:51,603 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-10-01 19:02:51,605 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 19:02:51,606 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 33 msec 2023-10-01 19:02:51,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-10-01 19:02:51,683 INFO [Listener at jenkins-hbase4.apache.org/36885] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-10-01 19:02:51,684 INFO [Listener at jenkins-hbase4.apache.org/36885] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:51,684 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:51,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] procedure2.ProcedureExecutor(1028): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:51,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-10-01 19:02:51,688 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696186971688"}]},"ts":"1696186971688"} 2023-10-01 19:02:51,690 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-10-01 19:02:51,691 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-10-01 19:02:51,692 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=d8ccdbee47d9dad50b067aea85d7bcb5, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0d792d1c4ef8a508b4711b6f0a1ab34d, UNASSIGN}] 2023-10-01 19:02:51,694 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=d8ccdbee47d9dad50b067aea85d7bcb5, UNASSIGN 2023-10-01 19:02:51,694 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0d792d1c4ef8a508b4711b6f0a1ab34d, UNASSIGN 2023-10-01 19:02:51,694 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=d8ccdbee47d9dad50b067aea85d7bcb5, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:51,694 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=0d792d1c4ef8a508b4711b6f0a1ab34d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:51,694 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696186956080.d8ccdbee47d9dad50b067aea85d7bcb5.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696186971694"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696186971694"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696186971694"}]},"ts":"1696186971694"} 2023-10-01 19:02:51,694 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696186956080.0d792d1c4ef8a508b4711b6f0a1ab34d.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696186971694"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696186971694"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696186971694"}]},"ts":"1696186971694"} 2023-10-01 19:02:51,696 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure d8ccdbee47d9dad50b067aea85d7bcb5, server=jenkins-hbase4.apache.org,36507,1696186884612}] 2023-10-01 19:02:51,696 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure 0d792d1c4ef8a508b4711b6f0a1ab34d, server=jenkins-hbase4.apache.org,44933,1696186884649}] 2023-10-01 19:02:51,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-10-01 19:02:51,848 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close d8ccdbee47d9dad50b067aea85d7bcb5 2023-10-01 19:02:51,848 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d8ccdbee47d9dad50b067aea85d7bcb5, disabling compactions & flushes 2023-10-01 19:02:51,848 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1696186956080.d8ccdbee47d9dad50b067aea85d7bcb5. 2023-10-01 19:02:51,848 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1696186956080.d8ccdbee47d9dad50b067aea85d7bcb5. 2023-10-01 19:02:51,848 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1696186956080.d8ccdbee47d9dad50b067aea85d7bcb5. after waiting 0 ms 2023-10-01 19:02:51,848 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1696186956080.d8ccdbee47d9dad50b067aea85d7bcb5. 2023-10-01 19:02:51,852 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 0d792d1c4ef8a508b4711b6f0a1ab34d 2023-10-01 19:02:51,852 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0d792d1c4ef8a508b4711b6f0a1ab34d, disabling compactions & flushes 2023-10-01 19:02:51,852 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1696186956080.0d792d1c4ef8a508b4711b6f0a1ab34d. 2023-10-01 19:02:51,852 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1696186956080.0d792d1c4ef8a508b4711b6f0a1ab34d. 2023-10-01 19:02:51,852 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1696186956080.0d792d1c4ef8a508b4711b6f0a1ab34d. after waiting 0 ms 2023-10-01 19:02:51,852 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1696186956080.0d792d1c4ef8a508b4711b6f0a1ab34d. 2023-10-01 19:02:51,866 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemStateWithMergeRegion/d8ccdbee47d9dad50b067aea85d7bcb5/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-01 19:02:51,866 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemStateWithMergeRegion/0d792d1c4ef8a508b4711b6f0a1ab34d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-01 19:02:51,867 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 19:02:51,867 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 19:02:51,868 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1696186956080.d8ccdbee47d9dad50b067aea85d7bcb5. 2023-10-01 19:02:51,868 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d8ccdbee47d9dad50b067aea85d7bcb5: 2023-10-01 19:02:51,868 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1696186956080.0d792d1c4ef8a508b4711b6f0a1ab34d. 2023-10-01 19:02:51,868 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0d792d1c4ef8a508b4711b6f0a1ab34d: 2023-10-01 19:02:51,870 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed d8ccdbee47d9dad50b067aea85d7bcb5 2023-10-01 19:02:51,870 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=d8ccdbee47d9dad50b067aea85d7bcb5, regionState=CLOSED 2023-10-01 19:02:51,870 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696186956080.d8ccdbee47d9dad50b067aea85d7bcb5.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696186971870"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696186971870"}]},"ts":"1696186971870"} 2023-10-01 19:02:51,870 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 0d792d1c4ef8a508b4711b6f0a1ab34d 2023-10-01 19:02:51,871 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=0d792d1c4ef8a508b4711b6f0a1ab34d, regionState=CLOSED 2023-10-01 19:02:51,871 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696186956080.0d792d1c4ef8a508b4711b6f0a1ab34d.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696186971871"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696186971871"}]},"ts":"1696186971871"} 2023-10-01 19:02:51,873 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=87, resume processing ppid=85 2023-10-01 19:02:51,873 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure d8ccdbee47d9dad50b067aea85d7bcb5, server=jenkins-hbase4.apache.org,36507,1696186884612 in 175 msec 2023-10-01 19:02:51,874 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=88, resume processing ppid=86 2023-10-01 19:02:51,874 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=d8ccdbee47d9dad50b067aea85d7bcb5, UNASSIGN in 181 msec 2023-10-01 19:02:51,874 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure 0d792d1c4ef8a508b4711b6f0a1ab34d, server=jenkins-hbase4.apache.org,44933,1696186884649 in 176 msec 2023-10-01 19:02:51,876 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=86, resume processing ppid=84 2023-10-01 19:02:51,876 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0d792d1c4ef8a508b4711b6f0a1ab34d, UNASSIGN in 182 msec 2023-10-01 19:02:51,876 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696186971876"}]},"ts":"1696186971876"} 2023-10-01 19:02:51,877 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-10-01 19:02:51,879 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-10-01 19:02:51,880 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 195 msec 2023-10-01 19:02:51,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-10-01 19:02:51,990 INFO [Listener at jenkins-hbase4.apache.org/36885] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-10-01 19:02:51,991 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:51,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] procedure2.ProcedureExecutor(1028): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:51,994 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:51,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:51,995 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:51,996 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36507] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:51,999 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d8ccdbee47d9dad50b067aea85d7bcb5 2023-10-01 19:02:51,999 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0d792d1c4ef8a508b4711b6f0a1ab34d 2023-10-01 19:02:52,000 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:52,000 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:52,000 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:52,000 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:52,001 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d8ccdbee47d9dad50b067aea85d7bcb5/cf, FileablePath, hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d8ccdbee47d9dad50b067aea85d7bcb5/recovered.edits] 2023-10-01 19:02:52,001 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-10-01 19:02:52,001 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-10-01 19:02:52,001 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-10-01 19:02:52,001 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-10-01 19:02:52,002 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:52,002 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0d792d1c4ef8a508b4711b6f0a1ab34d/cf, FileablePath, hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0d792d1c4ef8a508b4711b6f0a1ab34d/recovered.edits] 2023-10-01 19:02:52,002 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:52,002 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 19:02:52,002 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:52,002 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 19:02:52,002 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 19:02:52,002 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:52,002 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 19:02:52,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-10-01 19:02:52,008 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d8ccdbee47d9dad50b067aea85d7bcb5/cf/41a13faa3f0746eca81b7bd18cd5bdaf to hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/d8ccdbee47d9dad50b067aea85d7bcb5/cf/41a13faa3f0746eca81b7bd18cd5bdaf 2023-10-01 19:02:52,008 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0d792d1c4ef8a508b4711b6f0a1ab34d/cf/904f9cc061e64e07b7c4184a22c8e63f to hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/0d792d1c4ef8a508b4711b6f0a1ab34d/cf/904f9cc061e64e07b7c4184a22c8e63f 2023-10-01 19:02:52,011 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d8ccdbee47d9dad50b067aea85d7bcb5/recovered.edits/9.seqid to hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/d8ccdbee47d9dad50b067aea85d7bcb5/recovered.edits/9.seqid 2023-10-01 19:02:52,011 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0d792d1c4ef8a508b4711b6f0a1ab34d/recovered.edits/9.seqid to hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/0d792d1c4ef8a508b4711b6f0a1ab34d/recovered.edits/9.seqid 2023-10-01 19:02:52,011 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d8ccdbee47d9dad50b067aea85d7bcb5 2023-10-01 19:02:52,011 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0d792d1c4ef8a508b4711b6f0a1ab34d 2023-10-01 19:02:52,011 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-10-01 19:02:52,012 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-10-01 19:02:52,012 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-10-01 19:02:52,016 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202310019d974567af524b5699c3b3dcfee5c03a to hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202310019d974567af524b5699c3b3dcfee5c03a 2023-10-01 19:02:52,017 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202310019361665ca8a540dbb8a43312be4674d9 to hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202310019361665ca8a540dbb8a43312be4674d9 2023-10-01 19:02:52,017 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-10-01 19:02:52,019 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:52,021 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-10-01 19:02:52,023 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-10-01 19:02:52,024 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:52,024 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-10-01 19:02:52,024 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696186956080.d8ccdbee47d9dad50b067aea85d7bcb5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696186972024"}]},"ts":"9223372036854775807"} 2023-10-01 19:02:52,024 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696186956080.0d792d1c4ef8a508b4711b6f0a1ab34d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696186972024"}]},"ts":"9223372036854775807"} 2023-10-01 19:02:52,026 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-01 19:02:52,026 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => d8ccdbee47d9dad50b067aea85d7bcb5, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1696186956080.d8ccdbee47d9dad50b067aea85d7bcb5.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 0d792d1c4ef8a508b4711b6f0a1ab34d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1696186956080.0d792d1c4ef8a508b4711b6f0a1ab34d.', STARTKEY => '1', ENDKEY => ''}] 2023-10-01 19:02:52,026 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-10-01 19:02:52,026 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696186972026"}]},"ts":"9223372036854775807"} 2023-10-01 19:02:52,027 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-10-01 19:02:52,029 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:52,030 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 38 msec 2023-10-01 19:02:52,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-10-01 19:02:52,104 INFO [Listener at jenkins-hbase4.apache.org/36885] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-10-01 19:02:52,113 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-10-01 19:02:52,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:52,116 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-10-01 19:02:52,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 19:02:52,119 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-10-01 19:02:52,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 19:02:52,144 INFO [Listener at jenkins-hbase4.apache.org/36885] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=761 (was 751) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-666097425_1 at /127.0.0.1:56844 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x618534e4-shared-pool-28 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-628947520_17 at /127.0.0.1:43030 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (32912118) connection to jenkins-hbase4.apache.org/172.31.14.131:38851 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-666097425_1 at /127.0.0.1:33776 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x618534e4-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x618534e4-shared-pool-27 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x618534e4-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-628947520_17 at /127.0.0.1:33796 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x618534e4-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-628947520_17 at /127.0.0.1:56868 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4074 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x618534e4-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=916 (was 905) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=233 (was 219) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=1196 (was 1250) 2023-10-01 19:02:52,144 WARN [Listener at jenkins-hbase4.apache.org/36885] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-10-01 19:02:52,163 INFO [Listener at jenkins-hbase4.apache.org/36885] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=761, OpenFileDescriptor=916, MaxFileDescriptor=60000, SystemLoadAverage=233, ProcessCount=168, AvailableMemoryMB=1195 2023-10-01 19:02:52,163 WARN [Listener at jenkins-hbase4.apache.org/36885] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-10-01 19:02:52,165 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-01 19:02:52,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] procedure2.ProcedureExecutor(1028): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-01 19:02:52,167 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-10-01 19:02:52,168 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-10-01 19:02:52,168 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-01 19:02:52,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-10-01 19:02:52,170 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testEmptyExportFileSystemState/1ab81941f3aa293a674a74ade4287fc0 2023-10-01 19:02:52,170 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testEmptyExportFileSystemState/0f3289d11428f6060d91cdb7b0d85f7a 2023-10-01 19:02:52,171 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testEmptyExportFileSystemState/1ab81941f3aa293a674a74ade4287fc0 empty. 2023-10-01 19:02:52,171 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testEmptyExportFileSystemState/0f3289d11428f6060d91cdb7b0d85f7a empty. 2023-10-01 19:02:52,171 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testEmptyExportFileSystemState/1ab81941f3aa293a674a74ade4287fc0 2023-10-01 19:02:52,171 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testEmptyExportFileSystemState/0f3289d11428f6060d91cdb7b0d85f7a 2023-10-01 19:02:52,172 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-10-01 19:02:52,180 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-10-01 19:02:52,181 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 1ab81941f3aa293a674a74ade4287fc0, NAME => 'testtb-testEmptyExportFileSystemState,,1696186972164.1ab81941f3aa293a674a74ade4287fc0.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp 2023-10-01 19:02:52,181 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 0f3289d11428f6060d91cdb7b0d85f7a, NAME => 'testtb-testEmptyExportFileSystemState,1,1696186972164.0f3289d11428f6060d91cdb7b0d85f7a.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp 2023-10-01 19:02:52,189 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1696186972164.0f3289d11428f6060d91cdb7b0d85f7a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 19:02:52,189 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1696186972164.1ab81941f3aa293a674a74ade4287fc0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 19:02:52,189 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 0f3289d11428f6060d91cdb7b0d85f7a, disabling compactions & flushes 2023-10-01 19:02:52,189 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 1ab81941f3aa293a674a74ade4287fc0, disabling compactions & flushes 2023-10-01 19:02:52,189 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1696186972164.0f3289d11428f6060d91cdb7b0d85f7a. 2023-10-01 19:02:52,189 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1696186972164.0f3289d11428f6060d91cdb7b0d85f7a. 2023-10-01 19:02:52,189 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1696186972164.1ab81941f3aa293a674a74ade4287fc0. 2023-10-01 19:02:52,189 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1696186972164.1ab81941f3aa293a674a74ade4287fc0. 2023-10-01 19:02:52,189 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1696186972164.0f3289d11428f6060d91cdb7b0d85f7a. after waiting 0 ms 2023-10-01 19:02:52,189 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1696186972164.0f3289d11428f6060d91cdb7b0d85f7a. 2023-10-01 19:02:52,189 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1696186972164.1ab81941f3aa293a674a74ade4287fc0. after waiting 0 ms 2023-10-01 19:02:52,189 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1696186972164.1ab81941f3aa293a674a74ade4287fc0. 2023-10-01 19:02:52,189 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1696186972164.0f3289d11428f6060d91cdb7b0d85f7a. 2023-10-01 19:02:52,189 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1696186972164.1ab81941f3aa293a674a74ade4287fc0. 2023-10-01 19:02:52,189 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 0f3289d11428f6060d91cdb7b0d85f7a: 2023-10-01 19:02:52,189 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 1ab81941f3aa293a674a74ade4287fc0: 2023-10-01 19:02:52,191 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-10-01 19:02:52,192 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1696186972164.0f3289d11428f6060d91cdb7b0d85f7a.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696186972192"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696186972192"}]},"ts":"1696186972192"} 2023-10-01 19:02:52,192 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1696186972164.1ab81941f3aa293a674a74ade4287fc0.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696186972192"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696186972192"}]},"ts":"1696186972192"} 2023-10-01 19:02:52,194 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-01 19:02:52,195 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-01 19:02:52,195 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696186972195"}]},"ts":"1696186972195"} 2023-10-01 19:02:52,196 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-10-01 19:02:52,199 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-01 19:02:52,200 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-01 19:02:52,200 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-01 19:02:52,200 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-01 19:02:52,200 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-01 19:02:52,201 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=1ab81941f3aa293a674a74ade4287fc0, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0f3289d11428f6060d91cdb7b0d85f7a, ASSIGN}] 2023-10-01 19:02:52,203 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=1ab81941f3aa293a674a74ade4287fc0, ASSIGN 2023-10-01 19:02:52,203 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0f3289d11428f6060d91cdb7b0d85f7a, ASSIGN 2023-10-01 19:02:52,204 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=1ab81941f3aa293a674a74ade4287fc0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44933,1696186884649; forceNewPlan=false, retain=false 2023-10-01 19:02:52,204 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0f3289d11428f6060d91cdb7b0d85f7a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36507,1696186884612; forceNewPlan=false, retain=false 2023-10-01 19:02:52,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-10-01 19:02:52,354 INFO [jenkins-hbase4:42819] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-01 19:02:52,357 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=0f3289d11428f6060d91cdb7b0d85f7a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:52,357 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=1ab81941f3aa293a674a74ade4287fc0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:52,357 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1696186972164.0f3289d11428f6060d91cdb7b0d85f7a.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696186972357"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696186972357"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696186972357"}]},"ts":"1696186972357"} 2023-10-01 19:02:52,357 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1696186972164.1ab81941f3aa293a674a74ade4287fc0.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696186972357"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696186972357"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696186972357"}]},"ts":"1696186972357"} 2023-10-01 19:02:52,358 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=93, ppid=92, state=RUNNABLE; OpenRegionProcedure 0f3289d11428f6060d91cdb7b0d85f7a, server=jenkins-hbase4.apache.org,36507,1696186884612}] 2023-10-01 19:02:52,359 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; OpenRegionProcedure 1ab81941f3aa293a674a74ade4287fc0, server=jenkins-hbase4.apache.org,44933,1696186884649}] 2023-10-01 19:02:52,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-10-01 19:02:52,513 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1696186972164.1ab81941f3aa293a674a74ade4287fc0. 2023-10-01 19:02:52,513 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1ab81941f3aa293a674a74ade4287fc0, NAME => 'testtb-testEmptyExportFileSystemState,,1696186972164.1ab81941f3aa293a674a74ade4287fc0.', STARTKEY => '', ENDKEY => '1'} 2023-10-01 19:02:52,513 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1696186972164.0f3289d11428f6060d91cdb7b0d85f7a. 2023-10-01 19:02:52,514 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1696186972164.1ab81941f3aa293a674a74ade4287fc0. service=AccessControlService 2023-10-01 19:02:52,514 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0f3289d11428f6060d91cdb7b0d85f7a, NAME => 'testtb-testEmptyExportFileSystemState,1,1696186972164.0f3289d11428f6060d91cdb7b0d85f7a.', STARTKEY => '1', ENDKEY => ''} 2023-10-01 19:02:52,514 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 19:02:52,514 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1696186972164.0f3289d11428f6060d91cdb7b0d85f7a. service=AccessControlService 2023-10-01 19:02:52,514 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 1ab81941f3aa293a674a74ade4287fc0 2023-10-01 19:02:52,514 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1696186972164.1ab81941f3aa293a674a74ade4287fc0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 19:02:52,514 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 19:02:52,514 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1ab81941f3aa293a674a74ade4287fc0 2023-10-01 19:02:52,514 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1ab81941f3aa293a674a74ade4287fc0 2023-10-01 19:02:52,514 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 0f3289d11428f6060d91cdb7b0d85f7a 2023-10-01 19:02:52,514 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1696186972164.0f3289d11428f6060d91cdb7b0d85f7a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 19:02:52,515 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0f3289d11428f6060d91cdb7b0d85f7a 2023-10-01 19:02:52,515 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0f3289d11428f6060d91cdb7b0d85f7a 2023-10-01 19:02:52,516 INFO [StoreOpener-1ab81941f3aa293a674a74ade4287fc0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 1ab81941f3aa293a674a74ade4287fc0 2023-10-01 19:02:52,516 INFO [StoreOpener-0f3289d11428f6060d91cdb7b0d85f7a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0f3289d11428f6060d91cdb7b0d85f7a 2023-10-01 19:02:52,517 DEBUG [StoreOpener-1ab81941f3aa293a674a74ade4287fc0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testEmptyExportFileSystemState/1ab81941f3aa293a674a74ade4287fc0/cf 2023-10-01 19:02:52,517 DEBUG [StoreOpener-1ab81941f3aa293a674a74ade4287fc0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testEmptyExportFileSystemState/1ab81941f3aa293a674a74ade4287fc0/cf 2023-10-01 19:02:52,517 DEBUG [StoreOpener-0f3289d11428f6060d91cdb7b0d85f7a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testEmptyExportFileSystemState/0f3289d11428f6060d91cdb7b0d85f7a/cf 2023-10-01 19:02:52,517 DEBUG [StoreOpener-0f3289d11428f6060d91cdb7b0d85f7a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testEmptyExportFileSystemState/0f3289d11428f6060d91cdb7b0d85f7a/cf 2023-10-01 19:02:52,518 INFO [StoreOpener-1ab81941f3aa293a674a74ade4287fc0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1ab81941f3aa293a674a74ade4287fc0 columnFamilyName cf 2023-10-01 19:02:52,518 INFO [StoreOpener-0f3289d11428f6060d91cdb7b0d85f7a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0f3289d11428f6060d91cdb7b0d85f7a columnFamilyName cf 2023-10-01 19:02:52,519 INFO [StoreOpener-1ab81941f3aa293a674a74ade4287fc0-1] regionserver.HStore(310): Store=1ab81941f3aa293a674a74ade4287fc0/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 19:02:52,519 INFO [StoreOpener-0f3289d11428f6060d91cdb7b0d85f7a-1] regionserver.HStore(310): Store=0f3289d11428f6060d91cdb7b0d85f7a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 19:02:52,520 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testEmptyExportFileSystemState/1ab81941f3aa293a674a74ade4287fc0 2023-10-01 19:02:52,520 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testEmptyExportFileSystemState/0f3289d11428f6060d91cdb7b0d85f7a 2023-10-01 19:02:52,521 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testEmptyExportFileSystemState/1ab81941f3aa293a674a74ade4287fc0 2023-10-01 19:02:52,521 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testEmptyExportFileSystemState/0f3289d11428f6060d91cdb7b0d85f7a 2023-10-01 19:02:52,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1ab81941f3aa293a674a74ade4287fc0 2023-10-01 19:02:52,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0f3289d11428f6060d91cdb7b0d85f7a 2023-10-01 19:02:52,526 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testEmptyExportFileSystemState/1ab81941f3aa293a674a74ade4287fc0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-01 19:02:52,526 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testEmptyExportFileSystemState/0f3289d11428f6060d91cdb7b0d85f7a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-01 19:02:52,527 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1ab81941f3aa293a674a74ade4287fc0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60061973, jitterRate=-0.1050068587064743}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-01 19:02:52,527 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0f3289d11428f6060d91cdb7b0d85f7a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69180732, jitterRate=0.030873239040374756}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-01 19:02:52,527 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1ab81941f3aa293a674a74ade4287fc0: 2023-10-01 19:02:52,527 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0f3289d11428f6060d91cdb7b0d85f7a: 2023-10-01 19:02:52,527 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1696186972164.0f3289d11428f6060d91cdb7b0d85f7a., pid=93, masterSystemTime=1696186972510 2023-10-01 19:02:52,527 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1696186972164.1ab81941f3aa293a674a74ade4287fc0., pid=94, masterSystemTime=1696186972510 2023-10-01 19:02:52,529 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1696186972164.0f3289d11428f6060d91cdb7b0d85f7a. 2023-10-01 19:02:52,529 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1696186972164.0f3289d11428f6060d91cdb7b0d85f7a. 2023-10-01 19:02:52,529 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=0f3289d11428f6060d91cdb7b0d85f7a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:52,529 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1696186972164.1ab81941f3aa293a674a74ade4287fc0. 2023-10-01 19:02:52,530 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1696186972164.1ab81941f3aa293a674a74ade4287fc0. 2023-10-01 19:02:52,530 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1696186972164.0f3289d11428f6060d91cdb7b0d85f7a.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696186972529"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696186972529"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696186972529"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696186972529"}]},"ts":"1696186972529"} 2023-10-01 19:02:52,530 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=1ab81941f3aa293a674a74ade4287fc0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:52,530 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1696186972164.1ab81941f3aa293a674a74ade4287fc0.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696186972530"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696186972530"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696186972530"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696186972530"}]},"ts":"1696186972530"} 2023-10-01 19:02:52,533 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=93, resume processing ppid=92 2023-10-01 19:02:52,533 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=93, ppid=92, state=SUCCESS; OpenRegionProcedure 0f3289d11428f6060d91cdb7b0d85f7a, server=jenkins-hbase4.apache.org,36507,1696186884612 in 173 msec 2023-10-01 19:02:52,533 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=94, resume processing ppid=91 2023-10-01 19:02:52,534 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=94, ppid=91, state=SUCCESS; OpenRegionProcedure 1ab81941f3aa293a674a74ade4287fc0, server=jenkins-hbase4.apache.org,44933,1696186884649 in 173 msec 2023-10-01 19:02:52,534 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0f3289d11428f6060d91cdb7b0d85f7a, ASSIGN in 332 msec 2023-10-01 19:02:52,535 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=91, resume processing ppid=90 2023-10-01 19:02:52,535 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=1ab81941f3aa293a674a74ade4287fc0, ASSIGN in 333 msec 2023-10-01 19:02:52,536 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-01 19:02:52,536 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696186972536"}]},"ts":"1696186972536"} 2023-10-01 19:02:52,537 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-10-01 19:02:52,539 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-10-01 19:02:52,539 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-10-01 19:02:52,541 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36507] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-10-01 19:02:52,542 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 19:02:52,542 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 19:02:52,542 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 19:02:52,542 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 19:02:52,543 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-01 19:02:52,543 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-01 19:02:52,543 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-01 19:02:52,543 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-01 19:02:52,545 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 379 msec 2023-10-01 19:02:52,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-10-01 19:02:52,772 INFO [Listener at jenkins-hbase4.apache.org/36885] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-10-01 19:02:52,774 DEBUG [Listener at jenkins-hbase4.apache.org/36885] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-10-01 19:02:52,774 DEBUG [Listener at jenkins-hbase4.apache.org/36885] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1696186972164.1ab81941f3aa293a674a74ade4287fc0. 2023-10-01 19:02:52,775 INFO [Listener at jenkins-hbase4.apache.org/36885] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-01 19:02:52,786 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-01 19:02:52,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696186972786 (current time:1696186972786). 2023-10-01 19:02:52,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-01 19:02:52,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(139): Connect 0x0a121d51 to 127.0.0.1:55462 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 19:02:52,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4276e166, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 19:02:52,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 19:02:52,802 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55152, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 19:02:52,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0a121d51 to 127.0.0.1:55462 2023-10-01 19:02:52,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 19:02:52,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(139): Connect 0x66b0c4d7 to 127.0.0.1:55462 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 19:02:52,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7cd2b5c5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 19:02:52,813 DEBUG [hconnection-0x95a16e8-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 19:02:52,814 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55156, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 19:02:52,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 19:02:52,820 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43640, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 19:02:52,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x66b0c4d7 to 127.0.0.1:55462 2023-10-01 19:02:52,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 19:02:52,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-10-01 19:02:52,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-01 19:02:52,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-01 19:02:52,824 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot, current working dir path: hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-01 19:02:52,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] procedure2.ProcedureExecutor(1028): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-01 19:02:52,829 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-01 19:02:52,830 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1696187572830 2023-10-01 19:02:52,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-01 19:02:52,830 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-10-01 19:02:52,831 DEBUG [Listener at jenkins-hbase4.apache.org/36885] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-01 19:02:52,831 DEBUG [Listener at jenkins-hbase4.apache.org/36885] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-01 19:02:52,832 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-01 19:02:52,832 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-01 19:02:52,833 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 4 msec 2023-10-01 19:02:52,836 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-01 19:02:52,836 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1696187572836 2023-10-01 19:02:52,845 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:52,845 INFO [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-10-01 19:02:52,845 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 19:02:52,846 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-10-01 19:02:52,846 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-10-01 19:02:52,846 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:52,846 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:52,853 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 19:02:52,853 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 19:02:52,853 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 19:02:52,853 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 19:02:52,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 19:02:52,853 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:52,853 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 19:02:52,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 19:02:52,853 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 19:02:52,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 19:02:52,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:52,853 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:52,853 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:52,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:52,854 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:52,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:52,854 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:52,854 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-01 19:02:52,854 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:52,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-10-01 19:02:52,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:52,854 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-01 19:02:52,855 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:52,855 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-01 19:02:52,855 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 19:02:52,856 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-01 19:02:52,856 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-01 19:02:52,856 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36507,1696186884612' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-10-01 19:02:52,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-10-01 19:02:52,856 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:52,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:52,856 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-01 19:02:52,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-10-01 19:02:52,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:52,857 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:52,857 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-01 19:02:52,857 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-01 19:02:52,857 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 19:02:52,857 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:52,858 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-01 19:02:52,858 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-01 19:02:52,858 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 19:02:52,858 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:52,858 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-01 19:02:52,859 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:52,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:52,859 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-01 19:02:52,859 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-01 19:02:52,859 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46609,1696186884566' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-10-01 19:02:52,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 19:02:52,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 19:02:52,859 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44933,1696186884649' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-10-01 19:02:52,859 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:52,859 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 19:02:52,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 19:02:52,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 19:02:52,861 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:52,861 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:52,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:52,862 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:52,862 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 19:02:52,862 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:52,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:52,862 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:52,862 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 19:02:52,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:52,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:52,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 19:02:52,863 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36507,1696186884612' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-10-01 19:02:52,863 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@10f36c78[Count = 1] remaining members to acquire global barrier 2023-10-01 19:02:52,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:52,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 19:02:52,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 19:02:52,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 19:02:52,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 19:02:52,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:52,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:52,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:52,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:52,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 19:02:52,866 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44933,1696186884649' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-10-01 19:02:52,866 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@10f36c78[Count = 0] remaining members to acquire global barrier 2023-10-01 19:02:52,866 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-10-01 19:02:52,866 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:52,868 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:52,868 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:52,868 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:52,868 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:52,868 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:52,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:52,868 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:52,868 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-01 19:02:52,868 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:52,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:52,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:52,869 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 19:02:52,869 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 19:02:52,869 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-01 19:02:52,869 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:52,869 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-10-01 19:02:52,869 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-01 19:02:52,869 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,46609,1696186884566' in zk 2023-10-01 19:02:52,869 DEBUG [rs(jenkins-hbase4.apache.org,44933,1696186884649)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1696186972164.1ab81941f3aa293a674a74ade4287fc0. 2023-10-01 19:02:52,869 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-01 19:02:52,869 DEBUG [rs(jenkins-hbase4.apache.org,44933,1696186884649)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1696186972164.1ab81941f3aa293a674a74ade4287fc0. started... 2023-10-01 19:02:52,869 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 19:02:52,869 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 19:02:52,869 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1696186972164.0f3289d11428f6060d91cdb7b0d85f7a. 2023-10-01 19:02:52,869 DEBUG [rs(jenkins-hbase4.apache.org,44933,1696186884649)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1ab81941f3aa293a674a74ade4287fc0: 2023-10-01 19:02:52,869 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1696186972164.0f3289d11428f6060d91cdb7b0d85f7a. started... 2023-10-01 19:02:52,870 DEBUG [rs(jenkins-hbase4.apache.org,44933,1696186884649)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1696186972164.1ab81941f3aa293a674a74ade4287fc0.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:52,871 DEBUG [rs(jenkins-hbase4.apache.org,44933,1696186884649)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 19:02:52,871 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0f3289d11428f6060d91cdb7b0d85f7a: 2023-10-01 19:02:52,871 DEBUG [rs(jenkins-hbase4.apache.org,44933,1696186884649)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-01 19:02:52,871 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1696186972164.0f3289d11428f6060d91cdb7b0d85f7a.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:52,871 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 19:02:52,871 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-01 19:02:52,871 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-01 19:02:52,871 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 19:02:52,871 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-10-01 19:02:52,879 DEBUG [rs(jenkins-hbase4.apache.org,44933,1696186884649)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1696186972164.1ab81941f3aa293a674a74ade4287fc0. completed. 2023-10-01 19:02:52,879 DEBUG [rs(jenkins-hbase4.apache.org,44933,1696186884649)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1696186972164.1ab81941f3aa293a674a74ade4287fc0. 2023-10-01 19:02:52,879 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 19:02:52,879 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 19:02:52,879 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:52,879 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-10-01 19:02:52,879 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44933,1696186884649' in zk 2023-10-01 19:02:52,880 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1696186972164.0f3289d11428f6060d91cdb7b0d85f7a. completed. 2023-10-01 19:02:52,880 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1696186972164.0f3289d11428f6060d91cdb7b0d85f7a. 2023-10-01 19:02:52,880 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 19:02:52,880 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 19:02:52,880 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:52,880 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-10-01 19:02:52,881 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,36507,1696186884612' in zk 2023-10-01 19:02:52,881 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:52,881 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-01 19:02:52,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:52,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 19:02:52,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 19:02:52,881 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 19:02:52,881 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-10-01 19:02:52,882 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-01 19:02:52,882 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 19:02:52,882 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:52,882 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-10-01 19:02:52,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 19:02:52,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 19:02:52,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:52,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:52,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:52,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:52,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 19:02:52,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:52,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:52,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:52,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:52,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,44933,1696186884649': 2023-10-01 19:02:52,886 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44933,1696186884649' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-10-01 19:02:52,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:52,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 19:02:52,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 19:02:52,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 19:02:52,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 19:02:52,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:52,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:52,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:52,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:52,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 19:02:52,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:52,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:52,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:52,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:52,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,36507,1696186884612': 2023-10-01 19:02:52,889 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36507,1696186884612' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-10-01 19:02:52,889 INFO [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-10-01 19:02:52,889 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-01 19:02:52,889 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-01 19:02:52,889 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:52,889 INFO [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-01 19:02:52,892 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:52,892 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:52,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:52,892 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:52,892 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:52,892 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:52,892 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:52,892 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 19:02:52,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:52,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 19:02:52,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 19:02:52,892 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 19:02:52,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:52,892 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:52,892 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:52,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:52,892 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 19:02:52,893 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 19:02:52,893 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 19:02:52,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 19:02:52,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 19:02:52,893 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:52,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 19:02:52,893 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 19:02:52,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 19:02:52,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:52,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:52,893 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:52,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:52,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:52,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 19:02:52,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:52,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:52,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:52,895 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:52,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:52,895 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:52,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 19:02:52,895 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:52,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:52,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:52,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:52,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:52,898 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 19:02:52,898 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 19:02:52,898 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 19:02:52,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 19:02:52,898 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 19:02:52,898 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 19:02:52,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 19:02:52,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 19:02:52,898 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:52,898 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 19:02:52,899 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:52,898 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:52,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 19:02:52,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 19:02:52,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 19:02:52,898 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 19:02:52,899 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 19:02:52,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 19:02:52,899 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-10-01 19:02:52,899 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:52,899 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:52,899 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:52,900 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-01 19:02:52,900 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 19:02:52,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 19:02:52,900 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:52,900 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 19:02:52,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 19:02:52,900 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:52,900 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:52,900 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:52,900 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:52,900 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:52,900 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:52,900 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-01 19:02:52,908 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:52,908 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:52,923 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:52,924 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-10-01 19:02:52,924 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:52,924 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:52,924 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1696186972830Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1696186972908 (+78 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1696186972908Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1696186972908Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1696186972911 (+3 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1696186972918 (+7 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1696186972924 (+6 ms) 2023-10-01 19:02:52,927 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-01 19:02:52,928 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 96 msec 2023-10-01 19:02:52,931 DEBUG [Listener at jenkins-hbase4.apache.org/36885] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 19:02:52,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-01 19:02:52,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-01 19:02:52,934 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44933] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1696186972164.1ab81941f3aa293a674a74ade4287fc0. with WAL disabled. Data may be lost in the event of a crash. 2023-10-01 19:02:52,936 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36507] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1696186972164.0f3289d11428f6060d91cdb7b0d85f7a. with WAL disabled. Data may be lost in the event of a crash. 2023-10-01 19:02:52,938 DEBUG [Listener at jenkins-hbase4.apache.org/36885] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-10-01 19:02:52,938 DEBUG [Listener at jenkins-hbase4.apache.org/36885] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1696186972164.1ab81941f3aa293a674a74ade4287fc0. 2023-10-01 19:02:52,938 INFO [Listener at jenkins-hbase4.apache.org/36885] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-01 19:02:52,947 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-01 19:02:52,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696186972947 (current time:1696186972947). 2023-10-01 19:02:52,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-01 19:02:52,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(139): Connect 0x58d8a563 to 127.0.0.1:55462 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 19:02:52,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@33263925, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 19:02:52,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 19:02:52,956 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55160, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 19:02:52,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x58d8a563 to 127.0.0.1:55462 2023-10-01 19:02:52,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 19:02:52,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(139): Connect 0x4f0e6403 to 127.0.0.1:55462 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 19:02:52,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5260333c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 19:02:52,970 DEBUG [hconnection-0x508dc744-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 19:02:52,972 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55174, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 19:02:52,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 19:02:52,976 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43650, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 19:02:52,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4f0e6403 to 127.0.0.1:55462 2023-10-01 19:02:52,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 19:02:52,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-10-01 19:02:52,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-01 19:02:52,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-01 19:02:52,980 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot, current working dir path: hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-01 19:02:52,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] procedure2.ProcedureExecutor(1028): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-01 19:02:52,982 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-01 19:02:52,983 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1696187572983 2023-10-01 19:02:52,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-01 19:02:52,983 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-10-01 19:02:52,984 DEBUG [Listener at jenkins-hbase4.apache.org/36885] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-01 19:02:52,984 DEBUG [Listener at jenkins-hbase4.apache.org/36885] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-01 19:02:52,985 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-01 19:02:52,985 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-01 19:02:52,986 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 4 msec 2023-10-01 19:02:52,987 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-01 19:02:52,987 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1696187572987 2023-10-01 19:02:52,995 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:52,995 INFO [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-10-01 19:02:52,995 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 19:02:52,997 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-10-01 19:02:52,997 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-10-01 19:02:52,997 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:52,997 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:52,998 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 19:02:52,998 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:52,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 19:02:52,998 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 19:02:52,998 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 19:02:52,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 19:02:52,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 19:02:52,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 19:02:52,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 19:02:52,998 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:52,999 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:52,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 19:02:52,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:52,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:52,999 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:52,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:52,999 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-01 19:02:52,999 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:52,999 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:52,999 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:52,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-10-01 19:02:52,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:52,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-10-01 19:02:53,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:53,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-10-01 19:02:53,000 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-01 19:02:53,000 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-01 19:02:53,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:53,000 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-01 19:02:53,000 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:53,000 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:53,000 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-01 19:02:53,000 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:53,000 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-01 19:02:53,000 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-01 19:02:53,000 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 19:02:53,000 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 19:02:53,000 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 19:02:53,001 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-01 19:02:53,002 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-01 19:02:53,005 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36507,1696186884612' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-10-01 19:02:53,002 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-01 19:02:53,005 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-01 19:02:53,006 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46609,1696186884566' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-10-01 19:02:53,005 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-01 19:02:53,006 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-01 19:02:53,006 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44933,1696186884649' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-10-01 19:02:53,007 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:53,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:53,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 19:02:53,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 19:02:53,008 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:53,009 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:53,010 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:53,010 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:53,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 19:02:53,010 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 19:02:53,010 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:53,010 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 19:02:53,010 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:53,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 19:02:53,011 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:53,011 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 19:02:53,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:53,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:53,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:53,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:53,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 19:02:53,012 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36507,1696186884612' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-10-01 19:02:53,012 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3f1a686f[Count = 1] remaining members to acquire global barrier 2023-10-01 19:02:53,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:53,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 19:02:53,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 19:02:53,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 19:02:53,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 19:02:53,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:53,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:53,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:53,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:53,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 19:02:53,014 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44933,1696186884649' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-10-01 19:02:53,014 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3f1a686f[Count = 0] remaining members to acquire global barrier 2023-10-01 19:02:53,014 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-10-01 19:02:53,014 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:53,018 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:53,018 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:53,018 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:53,018 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:53,018 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:53,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:53,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:53,018 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-01 19:02:53,018 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-01 19:02:53,018 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-10-01 19:02:53,018 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:53,018 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,46609,1696186884566' in zk 2023-10-01 19:02:53,018 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 19:02:53,018 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 19:02:53,018 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:53,018 DEBUG [rs(jenkins-hbase4.apache.org,44933,1696186884649)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1696186972164.1ab81941f3aa293a674a74ade4287fc0. 2023-10-01 19:02:53,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:53,019 DEBUG [rs(jenkins-hbase4.apache.org,44933,1696186884649)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1696186972164.1ab81941f3aa293a674a74ade4287fc0. started... 2023-10-01 19:02:53,019 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-01 19:02:53,019 INFO [rs(jenkins-hbase4.apache.org,44933,1696186884649)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 1ab81941f3aa293a674a74ade4287fc0 1/1 column families, dataSize=266 B heapSize=832 B 2023-10-01 19:02:53,019 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 19:02:53,019 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1696186972164.0f3289d11428f6060d91cdb7b0d85f7a. 2023-10-01 19:02:53,019 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:53,019 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-01 19:02:53,019 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1696186972164.0f3289d11428f6060d91cdb7b0d85f7a. started... 2023-10-01 19:02:53,019 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 19:02:53,019 INFO [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 0f3289d11428f6060d91cdb7b0d85f7a 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-10-01 19:02:53,021 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-01 19:02:53,021 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 19:02:53,021 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-10-01 19:02:53,039 INFO [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231001f756533c9d3b43eebafbfabd57982668 to hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20231001f756533c9d3b43eebafbfabd57982668 2023-10-01 19:02:53,040 INFO [rs(jenkins-hbase4.apache.org,44933,1696186884649)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310015c31d275ef484648b430554097e0677b to hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202310015c31d275ef484648b430554097e0677b 2023-10-01 19:02:53,050 INFO [rs(jenkins-hbase4.apache.org,44933,1696186884649)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testEmptyExportFileSystemState/1ab81941f3aa293a674a74ade4287fc0/.tmp/cf/b5d693508880489dabbe5e66b986872b 2023-10-01 19:02:53,051 INFO [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testEmptyExportFileSystemState/0f3289d11428f6060d91cdb7b0d85f7a/.tmp/cf/65406a6ac69e48a7a6469b22f2352105 2023-10-01 19:02:53,056 DEBUG [rs(jenkins-hbase4.apache.org,44933,1696186884649)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testEmptyExportFileSystemState/1ab81941f3aa293a674a74ade4287fc0/.tmp/cf/b5d693508880489dabbe5e66b986872b as hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testEmptyExportFileSystemState/1ab81941f3aa293a674a74ade4287fc0/cf/b5d693508880489dabbe5e66b986872b 2023-10-01 19:02:53,057 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testEmptyExportFileSystemState/0f3289d11428f6060d91cdb7b0d85f7a/.tmp/cf/65406a6ac69e48a7a6469b22f2352105 as hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testEmptyExportFileSystemState/0f3289d11428f6060d91cdb7b0d85f7a/cf/65406a6ac69e48a7a6469b22f2352105 2023-10-01 19:02:53,062 INFO [rs(jenkins-hbase4.apache.org,44933,1696186884649)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testEmptyExportFileSystemState/1ab81941f3aa293a674a74ade4287fc0/cf/b5d693508880489dabbe5e66b986872b, entries=4, sequenceid=6, filesize=5.6 K 2023-10-01 19:02:53,062 INFO [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testEmptyExportFileSystemState/0f3289d11428f6060d91cdb7b0d85f7a/cf/65406a6ac69e48a7a6469b22f2352105, entries=46, sequenceid=6, filesize=12.9 K 2023-10-01 19:02:53,062 INFO [rs(jenkins-hbase4.apache.org,44933,1696186884649)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 1ab81941f3aa293a674a74ade4287fc0 in 43ms, sequenceid=6, compaction requested=false 2023-10-01 19:02:53,063 INFO [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 0f3289d11428f6060d91cdb7b0d85f7a in 43ms, sequenceid=6, compaction requested=false 2023-10-01 19:02:53,063 DEBUG [rs(jenkins-hbase4.apache.org,44933,1696186884649)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-10-01 19:02:53,063 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-10-01 19:02:53,066 DEBUG [rs(jenkins-hbase4.apache.org,44933,1696186884649)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1ab81941f3aa293a674a74ade4287fc0: 2023-10-01 19:02:53,066 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0f3289d11428f6060d91cdb7b0d85f7a: 2023-10-01 19:02:53,066 DEBUG [rs(jenkins-hbase4.apache.org,44933,1696186884649)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1696186972164.1ab81941f3aa293a674a74ade4287fc0.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:53,066 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1696186972164.0f3289d11428f6060d91cdb7b0d85f7a.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:53,067 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 19:02:53,067 DEBUG [rs(jenkins-hbase4.apache.org,44933,1696186884649)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 19:02:53,067 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testEmptyExportFileSystemState/0f3289d11428f6060d91cdb7b0d85f7a/cf/65406a6ac69e48a7a6469b22f2352105] hfiles 2023-10-01 19:02:53,067 DEBUG [rs(jenkins-hbase4.apache.org,44933,1696186884649)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testEmptyExportFileSystemState/1ab81941f3aa293a674a74ade4287fc0/cf/b5d693508880489dabbe5e66b986872b] hfiles 2023-10-01 19:02:53,067 DEBUG [rs(jenkins-hbase4.apache.org,44933,1696186884649)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testEmptyExportFileSystemState/1ab81941f3aa293a674a74ade4287fc0/cf/b5d693508880489dabbe5e66b986872b for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:53,067 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testEmptyExportFileSystemState/0f3289d11428f6060d91cdb7b0d85f7a/cf/65406a6ac69e48a7a6469b22f2352105 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:53,076 DEBUG [rs(jenkins-hbase4.apache.org,44933,1696186884649)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1696186972164.1ab81941f3aa293a674a74ade4287fc0. completed. 2023-10-01 19:02:53,076 DEBUG [rs(jenkins-hbase4.apache.org,44933,1696186884649)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1696186972164.1ab81941f3aa293a674a74ade4287fc0. 2023-10-01 19:02:53,076 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 19:02:53,076 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 19:02:53,076 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:53,076 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-10-01 19:02:53,076 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1696186972164.0f3289d11428f6060d91cdb7b0d85f7a. completed. 2023-10-01 19:02:53,076 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1696186972164.0f3289d11428f6060d91cdb7b0d85f7a. 2023-10-01 19:02:53,076 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44933,1696186884649' in zk 2023-10-01 19:02:53,076 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 19:02:53,076 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 19:02:53,076 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:53,076 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-10-01 19:02:53,076 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,36507,1696186884612' in zk 2023-10-01 19:02:53,078 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:53,078 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-01 19:02:53,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:53,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 19:02:53,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 19:02:53,078 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 19:02:53,078 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-10-01 19:02:53,079 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:53,079 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-01 19:02:53,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 19:02:53,080 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 19:02:53,080 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-10-01 19:02:53,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 19:02:53,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:53,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:53,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:53,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:53,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 19:02:53,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:53,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:53,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:53,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:53,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,44933,1696186884649': 2023-10-01 19:02:53,083 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44933,1696186884649' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-10-01 19:02:53,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:53,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 19:02:53,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 19:02:53,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 19:02:53,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 19:02:53,084 DEBUG [Listener at jenkins-hbase4.apache.org/36885] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 19:02:53,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:53,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:53,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:53,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-01 19:02:53,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-01 19:02:53,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:53,085 DEBUG [Listener at jenkins-hbase4.apache.org/36885] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-01 19:02:53,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 19:02:53,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:53,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:53,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:53,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:53,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,36507,1696186884612': 2023-10-01 19:02:53,087 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36507,1696186884612' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-10-01 19:02:53,087 INFO [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-10-01 19:02:53,087 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-01 19:02:53,087 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-01 19:02:53,087 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:53,087 INFO [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-01 19:02:53,088 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:53,088 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:53,088 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:53,088 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:53,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:53,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:53,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 19:02:53,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 19:02:53,088 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 19:02:53,088 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:53,089 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 19:02:53,089 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:53,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:53,089 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 19:02:53,089 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:53,089 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:53,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 19:02:53,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:53,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 19:02:53,089 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 19:02:53,089 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 19:02:53,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 19:02:53,089 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:53,089 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 19:02:53,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:53,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 19:02:53,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:53,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:53,090 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:53,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:53,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 19:02:53,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:53,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:53,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:53,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:53,091 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:53,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 19:02:53,092 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:53,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:53,092 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:53,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:53,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:53,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:53,098 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:53,098 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 19:02:53,098 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 19:02:53,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 19:02:53,098 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 19:02:53,098 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:53,098 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 19:02:53,098 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 19:02:53,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 19:02:53,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 19:02:53,098 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 19:02:53,098 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:53,098 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:53,099 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-10-01 19:02:53,099 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:53,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 19:02:53,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 19:02:53,098 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 19:02:53,099 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 19:02:53,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 19:02:53,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 19:02:53,099 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:53,099 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:53,100 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-01 19:02:53,100 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:02:53,100 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 19:02:53,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 19:02:53,100 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:53,100 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 19:02:53,100 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:02:53,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 19:02:53,100 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:02:53,100 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:53,100 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:53,101 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20231001f756533c9d3b43eebafbfabd57982668, hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202310015c31d275ef484648b430554097e0677b] mob files 2023-10-01 19:02:53,101 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20231001f756533c9d3b43eebafbfabd57982668 2023-10-01 19:02:53,101 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202310015c31d275ef484648b430554097e0677b 2023-10-01 19:02:53,108 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:53,109 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:53,123 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:53,124 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-10-01 19:02:53,124 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:53,124 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:53,124 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1696186972983Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1696186973108 (+125 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1696186973108Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1696186973108Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1696186973111 (+3 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1696186973118 (+7 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1696186973124 (+6 ms) 2023-10-01 19:02:53,129 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-01 19:02:53,130 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 145 msec 2023-10-01 19:02:53,285 DEBUG [Listener at jenkins-hbase4.apache.org/36885] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 19:02:53,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-01 19:02:53,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-01 19:02:53,287 INFO [Listener at jenkins-hbase4.apache.org/36885] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/export-test/export-1696186973287 2023-10-01 19:02:53,287 INFO [Listener at jenkins-hbase4.apache.org/36885] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:38933, tgtDir=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/export-test/export-1696186973287, rawTgtDir=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/export-test/export-1696186973287, srcFsUri=hdfs://localhost:38933, srcDir=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399 2023-10-01 19:02:53,310 DEBUG [Listener at jenkins-hbase4.apache.org/36885] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:38933, inputRoot=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399 2023-10-01 19:02:53,310 DEBUG [Listener at jenkins-hbase4.apache.org/36885] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_970277736_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/export-test/export-1696186973287, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/export-test/export-1696186973287/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:53,310 INFO [Listener at jenkins-hbase4.apache.org/36885] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:38933, inputRoot=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399, snapshotDir=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-10-01 19:02:53,315 INFO [Listener at jenkins-hbase4.apache.org/36885] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/export-test/export-1696186973287/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 19:02:53,335 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-01 19:02:53,336 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-01 19:02:53,336 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-01 19:02:53,336 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-01 19:02:54,205 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba/hadoop-692170868054000654.jar 2023-10-01 19:02:54,205 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-01 19:02:54,206 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-01 19:02:54,271 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba/hadoop-2602963670451846179.jar 2023-10-01 19:02:54,272 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-01 19:02:54,272 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-01 19:02:54,273 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-01 19:02:54,273 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-01 19:02:54,273 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-01 19:02:54,274 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-01 19:02:54,274 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-01 19:02:54,274 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-01 19:02:54,275 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-01 19:02:54,275 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-01 19:02:54,275 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-01 19:02:54,276 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-01 19:02:54,276 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-01 19:02:54,276 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-01 19:02:54,277 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-01 19:02:54,277 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-01 19:02:54,278 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 19:02:54,278 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 19:02:54,279 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 19:02:54,279 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 19:02:54,279 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 19:02:54,280 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 19:02:54,280 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 19:02:54,641 WARN [Listener at jenkins-hbase4.apache.org/36885] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-01 19:02:54,643 INFO [Listener at jenkins-hbase4.apache.org/36885] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-10-01 19:02:55,739 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-01 19:02:55,739 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-01 19:02:55,742 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696186890860_0005_000001 (auth:SIMPLE) 2023-10-01 19:02:56,284 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696186890860_0006_000001 (auth:SIMPLE) 2023-10-01 19:02:57,044 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-01 19:03:00,045 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696186890860_0006_000001 (auth:SIMPLE) 2023-10-01 19:03:02,979 INFO [Listener at jenkins-hbase4.apache.org/36885] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-01 19:03:02,980 INFO [Listener at jenkins-hbase4.apache.org/36885] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-01 19:03:02,986 INFO [Listener at jenkins-hbase4.apache.org/36885] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 19:03:02,986 INFO [Listener at jenkins-hbase4.apache.org/36885] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-01 19:03:02,987 INFO [Listener at jenkins-hbase4.apache.org/36885] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-01 19:03:02,987 DEBUG [Listener at jenkins-hbase4.apache.org/36885] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-628947520_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 19:03:02,987 DEBUG [Listener at jenkins-hbase4.apache.org/36885] snapshot.TestExportSnapshot(367): hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-10-01 19:03:02,987 DEBUG [Listener at jenkins-hbase4.apache.org/36885] snapshot.TestExportSnapshot(367): hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-10-01 19:03:02,987 DEBUG [Listener at jenkins-hbase4.apache.org/36885] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-628947520_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/export-test/export-1696186973287/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/export-test/export-1696186973287/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 19:03:02,988 DEBUG [Listener at jenkins-hbase4.apache.org/36885] snapshot.TestExportSnapshot(367): hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/export-test/export-1696186973287/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-10-01 19:03:02,988 DEBUG [Listener at jenkins-hbase4.apache.org/36885] snapshot.TestExportSnapshot(367): hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/export-test/export-1696186973287/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-10-01 19:03:02,992 INFO [Listener at jenkins-hbase4.apache.org/36885] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-10-01 19:03:02,993 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-10-01 19:03:02,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] procedure2.ProcedureExecutor(1028): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-01 19:03:02,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-10-01 19:03:02,997 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696186982996"}]},"ts":"1696186982996"} 2023-10-01 19:03:02,998 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-10-01 19:03:02,999 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-10-01 19:03:03,000 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=1ab81941f3aa293a674a74ade4287fc0, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0f3289d11428f6060d91cdb7b0d85f7a, UNASSIGN}] 2023-10-01 19:03:03,002 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=1ab81941f3aa293a674a74ade4287fc0, UNASSIGN 2023-10-01 19:03:03,002 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0f3289d11428f6060d91cdb7b0d85f7a, UNASSIGN 2023-10-01 19:03:03,002 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=1ab81941f3aa293a674a74ade4287fc0, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:03:03,002 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=0f3289d11428f6060d91cdb7b0d85f7a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:03:03,002 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1696186972164.1ab81941f3aa293a674a74ade4287fc0.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696186983002"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696186983002"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696186983002"}]},"ts":"1696186983002"} 2023-10-01 19:03:03,003 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1696186972164.0f3289d11428f6060d91cdb7b0d85f7a.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696186983002"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696186983002"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696186983002"}]},"ts":"1696186983002"} 2023-10-01 19:03:03,004 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure 1ab81941f3aa293a674a74ade4287fc0, server=jenkins-hbase4.apache.org,44933,1696186884649}] 2023-10-01 19:03:03,004 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure 0f3289d11428f6060d91cdb7b0d85f7a, server=jenkins-hbase4.apache.org,36507,1696186884612}] 2023-10-01 19:03:03,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-10-01 19:03:03,155 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 1ab81941f3aa293a674a74ade4287fc0 2023-10-01 19:03:03,155 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 0f3289d11428f6060d91cdb7b0d85f7a 2023-10-01 19:03:03,156 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1ab81941f3aa293a674a74ade4287fc0, disabling compactions & flushes 2023-10-01 19:03:03,156 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0f3289d11428f6060d91cdb7b0d85f7a, disabling compactions & flushes 2023-10-01 19:03:03,156 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1696186972164.1ab81941f3aa293a674a74ade4287fc0. 2023-10-01 19:03:03,156 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1696186972164.0f3289d11428f6060d91cdb7b0d85f7a. 2023-10-01 19:03:03,156 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1696186972164.1ab81941f3aa293a674a74ade4287fc0. 2023-10-01 19:03:03,156 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1696186972164.0f3289d11428f6060d91cdb7b0d85f7a. 2023-10-01 19:03:03,156 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1696186972164.1ab81941f3aa293a674a74ade4287fc0. after waiting 0 ms 2023-10-01 19:03:03,156 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1696186972164.1ab81941f3aa293a674a74ade4287fc0. 2023-10-01 19:03:03,156 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1696186972164.0f3289d11428f6060d91cdb7b0d85f7a. after waiting 0 ms 2023-10-01 19:03:03,156 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1696186972164.0f3289d11428f6060d91cdb7b0d85f7a. 2023-10-01 19:03:03,164 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testEmptyExportFileSystemState/0f3289d11428f6060d91cdb7b0d85f7a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-01 19:03:03,164 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testEmptyExportFileSystemState/1ab81941f3aa293a674a74ade4287fc0/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-01 19:03:03,164 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 19:03:03,164 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 19:03:03,165 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1696186972164.1ab81941f3aa293a674a74ade4287fc0. 2023-10-01 19:03:03,165 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1696186972164.0f3289d11428f6060d91cdb7b0d85f7a. 2023-10-01 19:03:03,165 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0f3289d11428f6060d91cdb7b0d85f7a: 2023-10-01 19:03:03,165 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1ab81941f3aa293a674a74ade4287fc0: 2023-10-01 19:03:03,166 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 1ab81941f3aa293a674a74ade4287fc0 2023-10-01 19:03:03,167 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=1ab81941f3aa293a674a74ade4287fc0, regionState=CLOSED 2023-10-01 19:03:03,167 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1696186972164.1ab81941f3aa293a674a74ade4287fc0.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696186983167"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696186983167"}]},"ts":"1696186983167"} 2023-10-01 19:03:03,167 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 0f3289d11428f6060d91cdb7b0d85f7a 2023-10-01 19:03:03,167 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=0f3289d11428f6060d91cdb7b0d85f7a, regionState=CLOSED 2023-10-01 19:03:03,168 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1696186972164.0f3289d11428f6060d91cdb7b0d85f7a.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696186983167"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696186983167"}]},"ts":"1696186983167"} 2023-10-01 19:03:03,170 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=102, resume processing ppid=100 2023-10-01 19:03:03,170 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure 1ab81941f3aa293a674a74ade4287fc0, server=jenkins-hbase4.apache.org,44933,1696186884649 in 164 msec 2023-10-01 19:03:03,171 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=103, resume processing ppid=101 2023-10-01 19:03:03,171 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure 0f3289d11428f6060d91cdb7b0d85f7a, server=jenkins-hbase4.apache.org,36507,1696186884612 in 165 msec 2023-10-01 19:03:03,171 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=1ab81941f3aa293a674a74ade4287fc0, UNASSIGN in 170 msec 2023-10-01 19:03:03,172 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=101, resume processing ppid=99 2023-10-01 19:03:03,172 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0f3289d11428f6060d91cdb7b0d85f7a, UNASSIGN in 171 msec 2023-10-01 19:03:03,173 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696186983173"}]},"ts":"1696186983173"} 2023-10-01 19:03:03,174 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-10-01 19:03:03,175 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-10-01 19:03:03,176 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 182 msec 2023-10-01 19:03:03,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-10-01 19:03:03,299 INFO [Listener at jenkins-hbase4.apache.org/36885] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-10-01 19:03:03,299 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-10-01 19:03:03,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] procedure2.ProcedureExecutor(1028): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-01 19:03:03,302 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-01 19:03:03,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-10-01 19:03:03,303 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-01 19:03:03,304 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36507] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-10-01 19:03:03,307 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testEmptyExportFileSystemState/1ab81941f3aa293a674a74ade4287fc0 2023-10-01 19:03:03,307 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testEmptyExportFileSystemState/0f3289d11428f6060d91cdb7b0d85f7a 2023-10-01 19:03:03,309 DEBUG [HFileArchiver-18] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testEmptyExportFileSystemState/1ab81941f3aa293a674a74ade4287fc0/cf, FileablePath, hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testEmptyExportFileSystemState/1ab81941f3aa293a674a74ade4287fc0/recovered.edits] 2023-10-01 19:03:03,309 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testEmptyExportFileSystemState/0f3289d11428f6060d91cdb7b0d85f7a/cf, FileablePath, hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testEmptyExportFileSystemState/0f3289d11428f6060d91cdb7b0d85f7a/recovered.edits] 2023-10-01 19:03:03,310 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-01 19:03:03,310 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-01 19:03:03,310 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-01 19:03:03,310 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-01 19:03:03,311 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-10-01 19:03:03,311 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-10-01 19:03:03,311 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-10-01 19:03:03,311 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-10-01 19:03:03,312 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-01 19:03:03,312 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-01 19:03:03,312 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-01 19:03:03,312 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 19:03:03,312 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-01 19:03:03,312 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 19:03:03,312 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 19:03:03,312 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 19:03:03,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-10-01 19:03:03,313 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testEmptyExportFileSystemState/1ab81941f3aa293a674a74ade4287fc0/cf/b5d693508880489dabbe5e66b986872b to hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/archive/data/default/testtb-testEmptyExportFileSystemState/1ab81941f3aa293a674a74ade4287fc0/cf/b5d693508880489dabbe5e66b986872b 2023-10-01 19:03:03,314 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testEmptyExportFileSystemState/0f3289d11428f6060d91cdb7b0d85f7a/cf/65406a6ac69e48a7a6469b22f2352105 to hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/archive/data/default/testtb-testEmptyExportFileSystemState/0f3289d11428f6060d91cdb7b0d85f7a/cf/65406a6ac69e48a7a6469b22f2352105 2023-10-01 19:03:03,316 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testEmptyExportFileSystemState/1ab81941f3aa293a674a74ade4287fc0/recovered.edits/9.seqid to hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/archive/data/default/testtb-testEmptyExportFileSystemState/1ab81941f3aa293a674a74ade4287fc0/recovered.edits/9.seqid 2023-10-01 19:03:03,316 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testEmptyExportFileSystemState/0f3289d11428f6060d91cdb7b0d85f7a/recovered.edits/9.seqid to hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/archive/data/default/testtb-testEmptyExportFileSystemState/0f3289d11428f6060d91cdb7b0d85f7a/recovered.edits/9.seqid 2023-10-01 19:03:03,317 DEBUG [HFileArchiver-18] backup.HFileArchiver(596): Deleted hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testEmptyExportFileSystemState/1ab81941f3aa293a674a74ade4287fc0 2023-10-01 19:03:03,317 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testEmptyExportFileSystemState/0f3289d11428f6060d91cdb7b0d85f7a 2023-10-01 19:03:03,317 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-10-01 19:03:03,317 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-10-01 19:03:03,318 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-10-01 19:03:03,320 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20231001f756533c9d3b43eebafbfabd57982668 to hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20231001f756533c9d3b43eebafbfabd57982668 2023-10-01 19:03:03,321 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202310015c31d275ef484648b430554097e0677b to hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202310015c31d275ef484648b430554097e0677b 2023-10-01 19:03:03,322 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-10-01 19:03:03,324 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-01 19:03:03,326 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-10-01 19:03:03,328 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-10-01 19:03:03,329 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-01 19:03:03,329 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-10-01 19:03:03,329 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1696186972164.1ab81941f3aa293a674a74ade4287fc0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696186983329"}]},"ts":"9223372036854775807"} 2023-10-01 19:03:03,329 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1696186972164.0f3289d11428f6060d91cdb7b0d85f7a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696186983329"}]},"ts":"9223372036854775807"} 2023-10-01 19:03:03,330 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-01 19:03:03,330 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 1ab81941f3aa293a674a74ade4287fc0, NAME => 'testtb-testEmptyExportFileSystemState,,1696186972164.1ab81941f3aa293a674a74ade4287fc0.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 0f3289d11428f6060d91cdb7b0d85f7a, NAME => 'testtb-testEmptyExportFileSystemState,1,1696186972164.0f3289d11428f6060d91cdb7b0d85f7a.', STARTKEY => '1', ENDKEY => ''}] 2023-10-01 19:03:03,330 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-10-01 19:03:03,330 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696186983330"}]},"ts":"9223372036854775807"} 2023-10-01 19:03:03,332 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-10-01 19:03:03,333 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-01 19:03:03,334 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 34 msec 2023-10-01 19:03:03,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-10-01 19:03:03,414 INFO [Listener at jenkins-hbase4.apache.org/36885] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-10-01 19:03:03,421 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-10-01 19:03:03,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 19:03:03,424 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-10-01 19:03:03,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-10-01 19:03:03,454 INFO [Listener at jenkins-hbase4.apache.org/36885] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=767 (was 761) Potentially hanging thread: hconnection-0x618534e4-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-628947520_17 at /127.0.0.1:45700 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4727 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x618534e4-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-628947520_17 at /127.0.0.1:58856 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (32912118) connection to jenkins-hbase4.apache.org/172.31.14.131:44699 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1127189491_1 at /127.0.0.1:58802 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (32912118) connection to jenkins-hbase4.apache.org/172.31.14.131:45293 from appattempt_1696186890860_0005_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1127189491_1 at /127.0.0.1:45676 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x618534e4-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (32912118) connection to jenkins-hbase4.apache.org/172.31.14.131:40145 from appattempt_1696186890860_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-628947520_17 at /127.0.0.1:39542 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x618534e4-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=925 (was 916) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=236 (was 233) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=1073 (was 1195) 2023-10-01 19:03:03,454 WARN [Listener at jenkins-hbase4.apache.org/36885] hbase.ResourceChecker(130): Thread=767 is superior to 500 2023-10-01 19:03:03,475 INFO [Listener at jenkins-hbase4.apache.org/36885] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=767, OpenFileDescriptor=925, MaxFileDescriptor=60000, SystemLoadAverage=236, ProcessCount=168, AvailableMemoryMB=1073 2023-10-01 19:03:03,475 WARN [Listener at jenkins-hbase4.apache.org/36885] hbase.ResourceChecker(130): Thread=767 is superior to 500 2023-10-01 19:03:03,477 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-01 19:03:03,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] procedure2.ProcedureExecutor(1028): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:03,480 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-10-01 19:03:03,480 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-10-01 19:03:03,481 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-01 19:03:03,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-01 19:03:03,483 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/cb9d3d213986d485e411b982b4398735 2023-10-01 19:03:03,483 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9b954e7b768e48930e50db33f935fb02 2023-10-01 19:03:03,484 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/cb9d3d213986d485e411b982b4398735 empty. 2023-10-01 19:03:03,484 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9b954e7b768e48930e50db33f935fb02 empty. 2023-10-01 19:03:03,484 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/cb9d3d213986d485e411b982b4398735 2023-10-01 19:03:03,484 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9b954e7b768e48930e50db33f935fb02 2023-10-01 19:03:03,484 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-10-01 19:03:03,500 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-10-01 19:03:03,501 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => cb9d3d213986d485e411b982b4398735, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1696186983476.cb9d3d213986d485e411b982b4398735.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp 2023-10-01 19:03:03,501 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 9b954e7b768e48930e50db33f935fb02, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1696186983476.9b954e7b768e48930e50db33f935fb02.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp 2023-10-01 19:03:03,516 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1696186983476.9b954e7b768e48930e50db33f935fb02.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 19:03:03,516 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 9b954e7b768e48930e50db33f935fb02, disabling compactions & flushes 2023-10-01 19:03:03,516 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1696186983476.9b954e7b768e48930e50db33f935fb02. 2023-10-01 19:03:03,516 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1696186983476.9b954e7b768e48930e50db33f935fb02. 2023-10-01 19:03:03,516 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1696186983476.9b954e7b768e48930e50db33f935fb02. after waiting 0 ms 2023-10-01 19:03:03,516 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1696186983476.9b954e7b768e48930e50db33f935fb02. 2023-10-01 19:03:03,516 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1696186983476.9b954e7b768e48930e50db33f935fb02. 2023-10-01 19:03:03,516 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 9b954e7b768e48930e50db33f935fb02: 2023-10-01 19:03:03,517 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1696186983476.cb9d3d213986d485e411b982b4398735.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 19:03:03,517 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing cb9d3d213986d485e411b982b4398735, disabling compactions & flushes 2023-10-01 19:03:03,517 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1696186983476.cb9d3d213986d485e411b982b4398735. 2023-10-01 19:03:03,517 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1696186983476.cb9d3d213986d485e411b982b4398735. 2023-10-01 19:03:03,517 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1696186983476.cb9d3d213986d485e411b982b4398735. after waiting 0 ms 2023-10-01 19:03:03,517 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1696186983476.cb9d3d213986d485e411b982b4398735. 2023-10-01 19:03:03,518 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1696186983476.cb9d3d213986d485e411b982b4398735. 2023-10-01 19:03:03,518 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for cb9d3d213986d485e411b982b4398735: 2023-10-01 19:03:03,520 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-10-01 19:03:03,521 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696186983476.9b954e7b768e48930e50db33f935fb02.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696186983520"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696186983520"}]},"ts":"1696186983520"} 2023-10-01 19:03:03,521 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696186983476.cb9d3d213986d485e411b982b4398735.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696186983520"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696186983520"}]},"ts":"1696186983520"} 2023-10-01 19:03:03,522 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-01 19:03:03,523 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-01 19:03:03,523 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696186983523"}]},"ts":"1696186983523"} 2023-10-01 19:03:03,524 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-10-01 19:03:03,528 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-01 19:03:03,529 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-01 19:03:03,529 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-01 19:03:03,529 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-01 19:03:03,529 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-01 19:03:03,529 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=cb9d3d213986d485e411b982b4398735, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9b954e7b768e48930e50db33f935fb02, ASSIGN}] 2023-10-01 19:03:03,531 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9b954e7b768e48930e50db33f935fb02, ASSIGN 2023-10-01 19:03:03,532 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=cb9d3d213986d485e411b982b4398735, ASSIGN 2023-10-01 19:03:03,532 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9b954e7b768e48930e50db33f935fb02, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46609,1696186884566; forceNewPlan=false, retain=false 2023-10-01 19:03:03,532 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=cb9d3d213986d485e411b982b4398735, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36507,1696186884612; forceNewPlan=false, retain=false 2023-10-01 19:03:03,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-01 19:03:03,682 INFO [jenkins-hbase4:42819] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-01 19:03:03,685 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=9b954e7b768e48930e50db33f935fb02, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:03:03,685 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=cb9d3d213986d485e411b982b4398735, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:03:03,685 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696186983476.9b954e7b768e48930e50db33f935fb02.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696186983685"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696186983685"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696186983685"}]},"ts":"1696186983685"} 2023-10-01 19:03:03,686 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696186983476.cb9d3d213986d485e411b982b4398735.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696186983685"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696186983685"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696186983685"}]},"ts":"1696186983685"} 2023-10-01 19:03:03,687 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=108, ppid=107, state=RUNNABLE; OpenRegionProcedure 9b954e7b768e48930e50db33f935fb02, server=jenkins-hbase4.apache.org,46609,1696186884566}] 2023-10-01 19:03:03,688 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure cb9d3d213986d485e411b982b4398735, server=jenkins-hbase4.apache.org,36507,1696186884612}] 2023-10-01 19:03:03,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-01 19:03:03,842 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1696186983476.cb9d3d213986d485e411b982b4398735. 2023-10-01 19:03:03,842 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => cb9d3d213986d485e411b982b4398735, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1696186983476.cb9d3d213986d485e411b982b4398735.', STARTKEY => '', ENDKEY => '1'} 2023-10-01 19:03:03,842 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1696186983476.9b954e7b768e48930e50db33f935fb02. 2023-10-01 19:03:03,842 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9b954e7b768e48930e50db33f935fb02, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1696186983476.9b954e7b768e48930e50db33f935fb02.', STARTKEY => '1', ENDKEY => ''} 2023-10-01 19:03:03,842 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1696186983476.cb9d3d213986d485e411b982b4398735. service=AccessControlService 2023-10-01 19:03:03,842 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1696186983476.9b954e7b768e48930e50db33f935fb02. service=AccessControlService 2023-10-01 19:03:03,842 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 19:03:03,842 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 19:03:03,843 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp cb9d3d213986d485e411b982b4398735 2023-10-01 19:03:03,843 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 9b954e7b768e48930e50db33f935fb02 2023-10-01 19:03:03,843 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1696186983476.cb9d3d213986d485e411b982b4398735.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 19:03:03,843 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1696186983476.9b954e7b768e48930e50db33f935fb02.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 19:03:03,843 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for cb9d3d213986d485e411b982b4398735 2023-10-01 19:03:03,843 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9b954e7b768e48930e50db33f935fb02 2023-10-01 19:03:03,843 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for cb9d3d213986d485e411b982b4398735 2023-10-01 19:03:03,843 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9b954e7b768e48930e50db33f935fb02 2023-10-01 19:03:03,844 INFO [StoreOpener-cb9d3d213986d485e411b982b4398735-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region cb9d3d213986d485e411b982b4398735 2023-10-01 19:03:03,844 INFO [StoreOpener-9b954e7b768e48930e50db33f935fb02-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 9b954e7b768e48930e50db33f935fb02 2023-10-01 19:03:03,845 DEBUG [StoreOpener-cb9d3d213986d485e411b982b4398735-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemStateWithSkipTmp/cb9d3d213986d485e411b982b4398735/cf 2023-10-01 19:03:03,845 DEBUG [StoreOpener-cb9d3d213986d485e411b982b4398735-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemStateWithSkipTmp/cb9d3d213986d485e411b982b4398735/cf 2023-10-01 19:03:03,845 DEBUG [StoreOpener-9b954e7b768e48930e50db33f935fb02-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemStateWithSkipTmp/9b954e7b768e48930e50db33f935fb02/cf 2023-10-01 19:03:03,845 DEBUG [StoreOpener-9b954e7b768e48930e50db33f935fb02-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemStateWithSkipTmp/9b954e7b768e48930e50db33f935fb02/cf 2023-10-01 19:03:03,846 INFO [StoreOpener-9b954e7b768e48930e50db33f935fb02-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9b954e7b768e48930e50db33f935fb02 columnFamilyName cf 2023-10-01 19:03:03,846 INFO [StoreOpener-cb9d3d213986d485e411b982b4398735-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cb9d3d213986d485e411b982b4398735 columnFamilyName cf 2023-10-01 19:03:03,847 INFO [StoreOpener-9b954e7b768e48930e50db33f935fb02-1] regionserver.HStore(310): Store=9b954e7b768e48930e50db33f935fb02/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 19:03:03,847 INFO [StoreOpener-cb9d3d213986d485e411b982b4398735-1] regionserver.HStore(310): Store=cb9d3d213986d485e411b982b4398735/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 19:03:03,848 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemStateWithSkipTmp/cb9d3d213986d485e411b982b4398735 2023-10-01 19:03:03,848 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemStateWithSkipTmp/9b954e7b768e48930e50db33f935fb02 2023-10-01 19:03:03,848 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemStateWithSkipTmp/cb9d3d213986d485e411b982b4398735 2023-10-01 19:03:03,848 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemStateWithSkipTmp/9b954e7b768e48930e50db33f935fb02 2023-10-01 19:03:03,851 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9b954e7b768e48930e50db33f935fb02 2023-10-01 19:03:03,851 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for cb9d3d213986d485e411b982b4398735 2023-10-01 19:03:03,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemStateWithSkipTmp/9b954e7b768e48930e50db33f935fb02/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-01 19:03:03,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemStateWithSkipTmp/cb9d3d213986d485e411b982b4398735/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-01 19:03:03,853 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9b954e7b768e48930e50db33f935fb02; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73766102, jitterRate=0.09920057654380798}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-01 19:03:03,853 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened cb9d3d213986d485e411b982b4398735; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65348535, jitterRate=-0.02623094618320465}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-01 19:03:03,853 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9b954e7b768e48930e50db33f935fb02: 2023-10-01 19:03:03,853 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for cb9d3d213986d485e411b982b4398735: 2023-10-01 19:03:03,854 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1696186983476.9b954e7b768e48930e50db33f935fb02., pid=108, masterSystemTime=1696186983839 2023-10-01 19:03:03,854 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1696186983476.cb9d3d213986d485e411b982b4398735., pid=109, masterSystemTime=1696186983839 2023-10-01 19:03:03,855 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1696186983476.cb9d3d213986d485e411b982b4398735. 2023-10-01 19:03:03,855 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1696186983476.cb9d3d213986d485e411b982b4398735. 2023-10-01 19:03:03,855 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=cb9d3d213986d485e411b982b4398735, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:03:03,855 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1696186983476.9b954e7b768e48930e50db33f935fb02. 2023-10-01 19:03:03,856 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1696186983476.9b954e7b768e48930e50db33f935fb02. 2023-10-01 19:03:03,856 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696186983476.cb9d3d213986d485e411b982b4398735.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696186983855"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696186983855"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696186983855"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696186983855"}]},"ts":"1696186983855"} 2023-10-01 19:03:03,856 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=9b954e7b768e48930e50db33f935fb02, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:03:03,856 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696186983476.9b954e7b768e48930e50db33f935fb02.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696186983856"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696186983856"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696186983856"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696186983856"}]},"ts":"1696186983856"} 2023-10-01 19:03:03,859 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=109, resume processing ppid=106 2023-10-01 19:03:03,859 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure cb9d3d213986d485e411b982b4398735, server=jenkins-hbase4.apache.org,36507,1696186884612 in 169 msec 2023-10-01 19:03:03,859 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=108, resume processing ppid=107 2023-10-01 19:03:03,859 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=108, ppid=107, state=SUCCESS; OpenRegionProcedure 9b954e7b768e48930e50db33f935fb02, server=jenkins-hbase4.apache.org,46609,1696186884566 in 171 msec 2023-10-01 19:03:03,860 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=cb9d3d213986d485e411b982b4398735, ASSIGN in 330 msec 2023-10-01 19:03:03,860 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=107, resume processing ppid=105 2023-10-01 19:03:03,860 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9b954e7b768e48930e50db33f935fb02, ASSIGN in 330 msec 2023-10-01 19:03:03,861 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-01 19:03:03,861 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696186983861"}]},"ts":"1696186983861"} 2023-10-01 19:03:03,862 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-10-01 19:03:03,864 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-10-01 19:03:03,864 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-10-01 19:03:03,866 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36507] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-10-01 19:03:03,867 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 19:03:03,867 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 19:03:03,867 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 19:03:03,867 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 19:03:03,870 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-10-01 19:03:03,870 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-10-01 19:03:03,870 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-10-01 19:03:03,871 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-10-01 19:03:03,872 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 393 msec 2023-10-01 19:03:04,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-01 19:03:04,084 INFO [Listener at jenkins-hbase4.apache.org/36885] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-10-01 19:03:04,087 DEBUG [Listener at jenkins-hbase4.apache.org/36885] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,087 DEBUG [Listener at jenkins-hbase4.apache.org/36885] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1696186983476.cb9d3d213986d485e411b982b4398735. 2023-10-01 19:03:04,088 INFO [Listener at jenkins-hbase4.apache.org/36885] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-01 19:03:04,098 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-01 19:03:04,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696186984098 (current time:1696186984098). 2023-10-01 19:03:04,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-01 19:03:04,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(139): Connect 0x6337a0cd to 127.0.0.1:55462 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 19:03:04,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@74f4565a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 19:03:04,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 19:03:04,109 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53232, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 19:03:04,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6337a0cd to 127.0.0.1:55462 2023-10-01 19:03:04,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 19:03:04,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(139): Connect 0x4c119ed3 to 127.0.0.1:55462 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 19:03:04,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@12fe6e54, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 19:03:04,116 DEBUG [hconnection-0x44eebcd7-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 19:03:04,118 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53238, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 19:03:04,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 19:03:04,124 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36460, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 19:03:04,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4c119ed3 to 127.0.0.1:55462 2023-10-01 19:03:04,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 19:03:04,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-10-01 19:03:04,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-01 19:03:04,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-01 19:03:04,128 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot, current working dir path: hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-01 19:03:04,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] procedure2.ProcedureExecutor(1028): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-01 19:03:04,130 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-01 19:03:04,130 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1696187584130 2023-10-01 19:03:04,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-01 19:03:04,130 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,131 DEBUG [Listener at jenkins-hbase4.apache.org/36885] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-01 19:03:04,131 DEBUG [Listener at jenkins-hbase4.apache.org/36885] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-01 19:03:04,132 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-01 19:03:04,132 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-01 19:03:04,134 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 4 msec 2023-10-01 19:03:04,135 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-01 19:03:04,135 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1696187584135 2023-10-01 19:03:04,148 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,149 INFO [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-10-01 19:03:04,149 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 19:03:04,150 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-10-01 19:03:04,150 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-10-01 19:03:04,150 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,150 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,152 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 19:03:04,152 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 19:03:04,152 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 19:03:04,152 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 19:03:04,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 19:03:04,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 19:03:04,152 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:03:04,152 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 19:03:04,152 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 19:03:04,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 19:03:04,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,152 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:03:04,152 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:03:04,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,152 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:03:04,152 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-01 19:03:04,152 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,153 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,153 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-10-01 19:03:04,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-10-01 19:03:04,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-10-01 19:03:04,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,153 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-01 19:03:04,153 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-01 19:03:04,153 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-01 19:03:04,153 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,153 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-01 19:03:04,153 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,153 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,154 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-01 19:03:04,154 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-01 19:03:04,154 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 19:03:04,153 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 19:03:04,155 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-01 19:03:04,155 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-01 19:03:04,154 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 19:03:04,156 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36507,1696186884612' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-01 19:03:04,156 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-01 19:03:04,156 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-01 19:03:04,156 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44933,1696186884649' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-01 19:03:04,155 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-01 19:03:04,156 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-01 19:03:04,156 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46609,1696186884566' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-01 19:03:04,163 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,163 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,163 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:03:04,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:03:04,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 19:03:04,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 19:03:04,163 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:03:04,163 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 19:03:04,163 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,164 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 19:03:04,163 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,164 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 19:03:04,164 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,164 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 19:03:04,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 19:03:04,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:03:04,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:03:04,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:03:04,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 19:03:04,165 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36507,1696186884612' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-10-01 19:03:04,165 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@32df134c[Count = 1] remaining members to acquire global barrier 2023-10-01 19:03:04,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:03:04,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 19:03:04,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 19:03:04,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 19:03:04,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 19:03:04,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:03:04,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:03:04,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:03:04,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 19:03:04,167 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46609,1696186884566' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-10-01 19:03:04,167 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@32df134c[Count = 0] remaining members to acquire global barrier 2023-10-01 19:03:04,167 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-10-01 19:03:04,167 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,168 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,168 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,168 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,168 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,168 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,168 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-01 19:03:04,168 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:03:04,168 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,169 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 19:03:04,169 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1696186983476.cb9d3d213986d485e411b982b4398735. 2023-10-01 19:03:04,169 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 19:03:04,169 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1696186983476.cb9d3d213986d485e411b982b4398735. started... 2023-10-01 19:03:04,169 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-01 19:03:04,169 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-01 19:03:04,169 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:03:04,169 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-01 19:03:04,169 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 19:03:04,169 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 19:03:04,169 DEBUG [rs(jenkins-hbase4.apache.org,46609,1696186884566)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1696186983476.9b954e7b768e48930e50db33f935fb02. 2023-10-01 19:03:04,169 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-01 19:03:04,169 DEBUG [rs(jenkins-hbase4.apache.org,46609,1696186884566)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1696186983476.9b954e7b768e48930e50db33f935fb02. started... 2023-10-01 19:03:04,169 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for cb9d3d213986d485e411b982b4398735: 2023-10-01 19:03:04,169 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,44933,1696186884649' in zk 2023-10-01 19:03:04,170 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1696186983476.cb9d3d213986d485e411b982b4398735.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,170 DEBUG [rs(jenkins-hbase4.apache.org,46609,1696186884566)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9b954e7b768e48930e50db33f935fb02: 2023-10-01 19:03:04,170 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 19:03:04,170 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-01 19:03:04,170 DEBUG [rs(jenkins-hbase4.apache.org,46609,1696186884566)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1696186983476.9b954e7b768e48930e50db33f935fb02.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,170 DEBUG [rs(jenkins-hbase4.apache.org,46609,1696186884566)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 19:03:04,171 DEBUG [rs(jenkins-hbase4.apache.org,46609,1696186884566)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-01 19:03:04,174 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-01 19:03:04,174 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 19:03:04,174 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-01 19:03:04,191 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1696186983476.cb9d3d213986d485e411b982b4398735. completed. 2023-10-01 19:03:04,192 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1696186983476.cb9d3d213986d485e411b982b4398735. 2023-10-01 19:03:04,192 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 19:03:04,192 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 19:03:04,192 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:03:04,192 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-01 19:03:04,192 DEBUG [rs(jenkins-hbase4.apache.org,46609,1696186884566)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1696186983476.9b954e7b768e48930e50db33f935fb02. completed. 2023-10-01 19:03:04,192 DEBUG [rs(jenkins-hbase4.apache.org,46609,1696186884566)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1696186983476.9b954e7b768e48930e50db33f935fb02. 2023-10-01 19:03:04,192 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,36507,1696186884612' in zk 2023-10-01 19:03:04,192 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 19:03:04,192 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 19:03:04,192 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:03:04,192 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-01 19:03:04,192 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,46609,1696186884566' in zk 2023-10-01 19:03:04,193 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:03:04,194 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-01 19:03:04,194 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-01 19:03:04,194 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 19:03:04,194 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 19:03:04,194 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-01 19:03:04,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:03:04,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 19:03:04,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 19:03:04,194 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:03:04,195 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-01 19:03:04,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 19:03:04,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 19:03:04,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:03:04,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:03:04,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:03:04,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 19:03:04,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:03:04,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:03:04,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:03:04,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,36507,1696186884612': 2023-10-01 19:03:04,200 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36507,1696186884612' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-10-01 19:03:04,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:03:04,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 19:03:04,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 19:03:04,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 19:03:04,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 19:03:04,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:03:04,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:03:04,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:03:04,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 19:03:04,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:03:04,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:03:04,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:03:04,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,46609,1696186884566': 2023-10-01 19:03:04,203 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46609,1696186884566' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-10-01 19:03:04,203 INFO [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-10-01 19:03:04,203 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-01 19:03:04,203 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-01 19:03:04,203 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,203 INFO [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-01 19:03:04,204 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,204 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 19:03:04,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 19:03:04,204 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,204 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,205 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 19:03:04,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,204 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 19:03:04,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,205 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 19:03:04,205 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:03:04,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 19:03:04,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 19:03:04,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 19:03:04,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 19:03:04,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 19:03:04,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 19:03:04,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 19:03:04,205 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:03:04,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,206 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:03:04,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 19:03:04,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:03:04,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:03:04,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:03:04,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 19:03:04,207 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:03:04,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,208 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:03:04,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:03:04,208 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:03:04,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:03:04,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:03:04,211 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:03:04,211 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 19:03:04,211 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 19:03:04,211 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 19:03:04,211 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,211 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 19:03:04,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 19:03:04,211 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 19:03:04,212 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 19:03:04,211 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 19:03:04,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 19:03:04,212 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 19:03:04,211 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 19:03:04,212 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 19:03:04,212 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 19:03:04,212 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:03:04,214 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 19:03:04,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 19:03:04,213 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,214 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 19:03:04,214 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,214 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:03:04,214 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 19:03:04,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 19:03:04,214 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,214 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-01 19:03:04,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 19:03:04,214 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:03:04,214 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,214 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:03:04,214 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:03:04,214 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,214 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,215 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-01 19:03:04,227 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,228 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,232 DEBUG [Listener at jenkins-hbase4.apache.org/36885] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 19:03:04,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-10-01 19:03:04,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-10-01 19:03:04,233 DEBUG [Listener at jenkins-hbase4.apache.org/36885] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-01 19:03:04,255 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,255 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-10-01 19:03:04,255 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,256 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,256 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1696186984130Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1696186984227 (+97 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1696186984227Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1696186984227Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1696186984231 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1696186984250 (+19 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1696186984255 (+5 ms) 2023-10-01 19:03:04,258 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-01 19:03:04,260 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 128 msec 2023-10-01 19:03:04,433 DEBUG [Listener at jenkins-hbase4.apache.org/36885] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 19:03:04,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-10-01 19:03:04,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-01 19:03:04,436 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36507] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1696186983476.cb9d3d213986d485e411b982b4398735. with WAL disabled. Data may be lost in the event of a crash. 2023-10-01 19:03:04,437 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46609] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1696186983476.9b954e7b768e48930e50db33f935fb02. with WAL disabled. Data may be lost in the event of a crash. 2023-10-01 19:03:04,439 DEBUG [Listener at jenkins-hbase4.apache.org/36885] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,439 DEBUG [Listener at jenkins-hbase4.apache.org/36885] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1696186983476.cb9d3d213986d485e411b982b4398735. 2023-10-01 19:03:04,440 INFO [Listener at jenkins-hbase4.apache.org/36885] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-01 19:03:04,448 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-01 19:03:04,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696186984448 (current time:1696186984448). 2023-10-01 19:03:04,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-01 19:03:04,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(139): Connect 0x03e6e459 to 127.0.0.1:55462 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 19:03:04,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5e6670f7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 19:03:04,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 19:03:04,459 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53244, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 19:03:04,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x03e6e459 to 127.0.0.1:55462 2023-10-01 19:03:04,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 19:03:04,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(139): Connect 0x27d08bdd to 127.0.0.1:55462 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 19:03:04,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@13a06752, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 19:03:04,466 DEBUG [hconnection-0x7e2c5c19-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 19:03:04,467 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53252, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 19:03:04,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 19:03:04,477 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36474, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 19:03:04,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x27d08bdd to 127.0.0.1:55462 2023-10-01 19:03:04,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 19:03:04,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-10-01 19:03:04,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-01 19:03:04,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-01 19:03:04,481 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot, current working dir path: hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-01 19:03:04,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] procedure2.ProcedureExecutor(1028): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-01 19:03:04,483 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-01 19:03:04,484 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1696187584484 2023-10-01 19:03:04,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-01 19:03:04,484 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,485 DEBUG [Listener at jenkins-hbase4.apache.org/36885] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-01 19:03:04,485 DEBUG [Listener at jenkins-hbase4.apache.org/36885] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-01 19:03:04,486 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-01 19:03:04,486 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-01 19:03:04,487 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 4 msec 2023-10-01 19:03:04,488 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-01 19:03:04,488 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1696187584488 2023-10-01 19:03:04,497 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,498 INFO [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-10-01 19:03:04,498 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 19:03:04,499 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-10-01 19:03:04,499 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-10-01 19:03:04,499 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,499 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,503 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 19:03:04,503 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 19:03:04,503 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 19:03:04,503 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 19:03:04,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 19:03:04,503 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:03:04,503 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 19:03:04,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 19:03:04,503 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 19:03:04,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 19:03:04,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,504 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:03:04,504 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:03:04,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,504 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,504 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,504 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:03:04,504 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-10-01 19:03:04,504 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-01 19:03:04,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-10-01 19:03:04,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-10-01 19:03:04,505 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-01 19:03:04,505 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-01 19:03:04,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,505 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,505 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,505 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-01 19:03:04,505 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-01 19:03:04,505 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 19:03:04,505 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-01 19:03:04,506 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-01 19:03:04,506 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-01 19:03:04,506 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36507,1696186884612' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-01 19:03:04,505 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,506 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 19:03:04,506 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-01 19:03:04,507 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-01 19:03:04,507 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 19:03:04,507 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-01 19:03:04,507 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44933,1696186884649' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-01 19:03:04,508 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-01 19:03:04,508 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-01 19:03:04,508 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46609,1696186884566' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-01 19:03:04,509 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,509 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:03:04,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:03:04,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 19:03:04,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 19:03:04,510 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,510 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 19:03:04,510 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,511 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 19:03:04,510 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 19:03:04,510 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,510 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:03:04,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 19:03:04,511 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,511 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 19:03:04,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:03:04,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:03:04,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:03:04,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 19:03:04,512 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36507,1696186884612' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-10-01 19:03:04,512 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6d72e77a[Count = 1] remaining members to acquire global barrier 2023-10-01 19:03:04,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:03:04,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 19:03:04,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 19:03:04,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 19:03:04,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 19:03:04,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:03:04,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:03:04,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:03:04,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 19:03:04,514 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46609,1696186884566' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-10-01 19:03:04,514 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6d72e77a[Count = 0] remaining members to acquire global barrier 2023-10-01 19:03:04,514 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-10-01 19:03:04,514 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,519 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,519 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,519 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,519 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,519 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,519 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-01 19:03:04,519 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,519 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:03:04,520 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-01 19:03:04,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,520 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 19:03:04,520 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 19:03:04,520 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 19:03:04,520 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 19:03:04,520 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-01 19:03:04,520 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:03:04,520 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-01 19:03:04,520 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-01 19:03:04,520 DEBUG [rs(jenkins-hbase4.apache.org,46609,1696186884566)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1696186983476.9b954e7b768e48930e50db33f935fb02. 2023-10-01 19:03:04,520 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1696186983476.cb9d3d213986d485e411b982b4398735. 2023-10-01 19:03:04,520 DEBUG [rs(jenkins-hbase4.apache.org,46609,1696186884566)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1696186983476.9b954e7b768e48930e50db33f935fb02. started... 2023-10-01 19:03:04,520 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1696186983476.cb9d3d213986d485e411b982b4398735. started... 2023-10-01 19:03:04,520 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,44933,1696186884649' in zk 2023-10-01 19:03:04,520 INFO [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] regionserver.HRegion(2745): Flushing cb9d3d213986d485e411b982b4398735 1/1 column families, dataSize=266 B heapSize=832 B 2023-10-01 19:03:04,520 INFO [rs(jenkins-hbase4.apache.org,46609,1696186884566)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 9b954e7b768e48930e50db33f935fb02 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-10-01 19:03:04,522 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-01 19:03:04,522 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 19:03:04,522 DEBUG [member: 'jenkins-hbase4.apache.org,44933,1696186884649' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-01 19:03:04,541 INFO [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310014516c888ce3f4366b450129374f8a83a to hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202310014516c888ce3f4366b450129374f8a83a 2023-10-01 19:03:04,544 INFO [rs(jenkins-hbase4.apache.org,46609,1696186884566)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310012a49a5900a0047f58e08ab22225fbfdb to hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202310012a49a5900a0047f58e08ab22225fbfdb 2023-10-01 19:03:04,548 INFO [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemStateWithSkipTmp/cb9d3d213986d485e411b982b4398735/.tmp/cf/1a4f207761ac4be5956f83a658563a2a 2023-10-01 19:03:04,550 INFO [rs(jenkins-hbase4.apache.org,46609,1696186884566)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemStateWithSkipTmp/9b954e7b768e48930e50db33f935fb02/.tmp/cf/61887aaa46da48929e93f13220a8150d 2023-10-01 19:03:04,552 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemStateWithSkipTmp/cb9d3d213986d485e411b982b4398735/.tmp/cf/1a4f207761ac4be5956f83a658563a2a as hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemStateWithSkipTmp/cb9d3d213986d485e411b982b4398735/cf/1a4f207761ac4be5956f83a658563a2a 2023-10-01 19:03:04,554 DEBUG [rs(jenkins-hbase4.apache.org,46609,1696186884566)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemStateWithSkipTmp/9b954e7b768e48930e50db33f935fb02/.tmp/cf/61887aaa46da48929e93f13220a8150d as hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemStateWithSkipTmp/9b954e7b768e48930e50db33f935fb02/cf/61887aaa46da48929e93f13220a8150d 2023-10-01 19:03:04,556 INFO [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemStateWithSkipTmp/cb9d3d213986d485e411b982b4398735/cf/1a4f207761ac4be5956f83a658563a2a, entries=4, sequenceid=6, filesize=5.6 K 2023-10-01 19:03:04,557 INFO [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for cb9d3d213986d485e411b982b4398735 in 37ms, sequenceid=6, compaction requested=false 2023-10-01 19:03:04,557 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-10-01 19:03:04,557 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for cb9d3d213986d485e411b982b4398735: 2023-10-01 19:03:04,557 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1696186983476.cb9d3d213986d485e411b982b4398735.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,557 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 19:03:04,557 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemStateWithSkipTmp/cb9d3d213986d485e411b982b4398735/cf/1a4f207761ac4be5956f83a658563a2a] hfiles 2023-10-01 19:03:04,558 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemStateWithSkipTmp/cb9d3d213986d485e411b982b4398735/cf/1a4f207761ac4be5956f83a658563a2a for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,558 INFO [rs(jenkins-hbase4.apache.org,46609,1696186884566)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemStateWithSkipTmp/9b954e7b768e48930e50db33f935fb02/cf/61887aaa46da48929e93f13220a8150d, entries=46, sequenceid=6, filesize=13.2 K 2023-10-01 19:03:04,559 INFO [rs(jenkins-hbase4.apache.org,46609,1696186884566)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 9b954e7b768e48930e50db33f935fb02 in 39ms, sequenceid=6, compaction requested=false 2023-10-01 19:03:04,561 DEBUG [rs(jenkins-hbase4.apache.org,46609,1696186884566)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9b954e7b768e48930e50db33f935fb02: 2023-10-01 19:03:04,561 DEBUG [rs(jenkins-hbase4.apache.org,46609,1696186884566)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1696186983476.9b954e7b768e48930e50db33f935fb02.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,561 DEBUG [rs(jenkins-hbase4.apache.org,46609,1696186884566)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 19:03:04,561 DEBUG [rs(jenkins-hbase4.apache.org,46609,1696186884566)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemStateWithSkipTmp/9b954e7b768e48930e50db33f935fb02/cf/61887aaa46da48929e93f13220a8150d] hfiles 2023-10-01 19:03:04,562 DEBUG [rs(jenkins-hbase4.apache.org,46609,1696186884566)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemStateWithSkipTmp/9b954e7b768e48930e50db33f935fb02/cf/61887aaa46da48929e93f13220a8150d for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,566 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1696186983476.cb9d3d213986d485e411b982b4398735. completed. 2023-10-01 19:03:04,566 DEBUG [rs(jenkins-hbase4.apache.org,36507,1696186884612)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1696186983476.cb9d3d213986d485e411b982b4398735. 2023-10-01 19:03:04,567 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 19:03:04,567 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 19:03:04,567 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:03:04,567 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-01 19:03:04,567 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,36507,1696186884612' in zk 2023-10-01 19:03:04,568 DEBUG [rs(jenkins-hbase4.apache.org,46609,1696186884566)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1696186983476.9b954e7b768e48930e50db33f935fb02. completed. 2023-10-01 19:03:04,568 DEBUG [rs(jenkins-hbase4.apache.org,46609,1696186884566)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1696186983476.9b954e7b768e48930e50db33f935fb02. 2023-10-01 19:03:04,568 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 19:03:04,568 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 19:03:04,568 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:03:04,568 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:03:04,569 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-01 19:03:04,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:03:04,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 19:03:04,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 19:03:04,569 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 19:03:04,569 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-01 19:03:04,569 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,46609,1696186884566' in zk 2023-10-01 19:03:04,569 DEBUG [member: 'jenkins-hbase4.apache.org,36507,1696186884612' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-01 19:03:04,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 19:03:04,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 19:03:04,571 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:03:04,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,571 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-01 19:03:04,572 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 19:03:04,572 DEBUG [member: 'jenkins-hbase4.apache.org,46609,1696186884566' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-01 19:03:04,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:03:04,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:03:04,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:03:04,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 19:03:04,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:03:04,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:03:04,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:03:04,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,36507,1696186884612': 2023-10-01 19:03:04,575 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36507,1696186884612' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-10-01 19:03:04,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:03:04,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 19:03:04,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 19:03:04,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 19:03:04,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 19:03:04,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:03:04,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:03:04,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:03:04,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 19:03:04,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:03:04,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:03:04,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:03:04,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,46609,1696186884566': 2023-10-01 19:03:04,578 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46609,1696186884566' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-10-01 19:03:04,578 INFO [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-10-01 19:03:04,578 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-01 19:03:04,578 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-01 19:03:04,578 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,578 INFO [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-01 19:03:04,580 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,580 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,580 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,580 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,580 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 19:03:04,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 19:03:04,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 19:03:04,580 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 19:03:04,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,580 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 19:03:04,581 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 19:03:04,581 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:03:04,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 19:03:04,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 19:03:04,581 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 19:03:04,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 19:03:04,581 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:03:04,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,582 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 19:03:04,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 19:03:04,582 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:03:04,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 19:03:04,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:03:04,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:03:04,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:03:04,584 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:03:04,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 19:03:04,584 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:03:04,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,584 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:03:04,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:03:04,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:03:04,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:03:04,585 DEBUG [Listener at jenkins-hbase4.apache.org/36885] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 19:03:04,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-10-01 19:03:04,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-10-01 19:03:04,586 DEBUG [Listener at jenkins-hbase4.apache.org/36885] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-01 19:03:04,587 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:03:04,587 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 19:03:04,587 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 19:03:04,587 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,587 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 19:03:04,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 19:03:04,587 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 19:03:04,587 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 19:03:04,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 19:03:04,587 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,587 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,587 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,587 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 19:03:04,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 19:03:04,587 DEBUG [(jenkins-hbase4.apache.org,42819,1696186883324)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 19:03:04,587 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:03:04,587 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 19:03:04,587 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 19:03:04,589 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 19:03:04,589 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 19:03:04,589 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 19:03:04,587 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:03:04,587 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-01 19:03:04,589 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 19:03:04,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 19:03:04,589 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:03:04,589 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,589 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:03:04,589 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:03:04,589 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,589 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 19:03:04,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 19:03:04,589 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,590 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202310012a49a5900a0047f58e08ab22225fbfdb, hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202310014516c888ce3f4366b450129374f8a83a] mob files 2023-10-01 19:03:04,590 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202310012a49a5900a0047f58e08ab22225fbfdb 2023-10-01 19:03:04,590 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202310014516c888ce3f4366b450129374f8a83a 2023-10-01 19:03:04,596 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,596 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,610 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,610 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-10-01 19:03:04,611 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,611 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,611 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1696186984484Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1696186984596 (+112 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1696186984596Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1696186984596Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1696186984598 (+2 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1696186984604 (+6 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1696186984610 (+6 ms) 2023-10-01 19:03:04,614 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-01 19:03:04,615 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 129 msec 2023-10-01 19:03:04,786 DEBUG [Listener at jenkins-hbase4.apache.org/36885] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 19:03:04,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-10-01 19:03:04,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-01 19:03:04,787 INFO [Listener at jenkins-hbase4.apache.org/36885] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/export-test/export-1696186984787 2023-10-01 19:03:04,788 INFO [Listener at jenkins-hbase4.apache.org/36885] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:38933, tgtDir=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/export-test/export-1696186984787, rawTgtDir=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/export-test/export-1696186984787, srcFsUri=hdfs://localhost:38933, srcDir=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399 2023-10-01 19:03:04,810 DEBUG [Listener at jenkins-hbase4.apache.org/36885] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:38933, inputRoot=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399 2023-10-01 19:03:04,810 DEBUG [Listener at jenkins-hbase4.apache.org/36885] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2118851171_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/export-test/export-1696186984787, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/export-test/export-1696186984787/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,810 INFO [Listener at jenkins-hbase4.apache.org/36885] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:38933, inputRoot=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399, snapshotDir=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-10-01 19:03:04,818 INFO [Listener at jenkins-hbase4.apache.org/36885] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/export-test/export-1696186984787/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:04,831 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-01 19:03:04,831 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-01 19:03:04,832 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-01 19:03:04,832 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-01 19:03:05,704 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba/hadoop-3283212802212730718.jar 2023-10-01 19:03:05,705 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-01 19:03:05,705 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-01 19:03:05,773 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba/hadoop-2253265032054390892.jar 2023-10-01 19:03:05,773 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-01 19:03:05,773 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-01 19:03:05,774 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-01 19:03:05,774 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-01 19:03:05,774 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-01 19:03:05,775 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-01 19:03:05,775 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-01 19:03:05,775 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-01 19:03:05,776 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-01 19:03:05,776 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-01 19:03:05,776 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-01 19:03:05,777 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-01 19:03:05,777 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-01 19:03:05,777 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-01 19:03:05,778 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-01 19:03:05,778 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-01 19:03:05,779 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 19:03:05,779 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 19:03:05,780 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 19:03:05,780 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 19:03:05,780 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 19:03:05,781 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 19:03:05,781 DEBUG [Listener at jenkins-hbase4.apache.org/36885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 19:03:06,132 WARN [Listener at jenkins-hbase4.apache.org/36885] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-01 19:03:06,135 INFO [Listener at jenkins-hbase4.apache.org/36885] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-10-01 19:03:06,137 DEBUG [Listener at jenkins-hbase4.apache.org/36885] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-10-01 19:03:07,348 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-01 19:03:07,348 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-01 19:03:07,354 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696186890860_0006_000001 (auth:SIMPLE) 2023-10-01 19:03:07,749 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696186890860_0007_000001 (auth:SIMPLE) 2023-10-01 19:03:08,765 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-01 19:03:11,399 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696186890860_0007_000001 (auth:SIMPLE) 2023-10-01 19:03:13,628 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696186890860_0007_000001 (auth:SIMPLE) 2023-10-01 19:03:16,190 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696186890860_0007_000001 (auth:SIMPLE) 2023-10-01 19:03:17,298 INFO [Listener at jenkins-hbase4.apache.org/36885] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-01 19:03:17,298 INFO [Listener at jenkins-hbase4.apache.org/36885] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-01 19:03:17,310 INFO [Listener at jenkins-hbase4.apache.org/36885] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:17,310 INFO [Listener at jenkins-hbase4.apache.org/36885] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-01 19:03:17,310 INFO [Listener at jenkins-hbase4.apache.org/36885] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-01 19:03:17,311 DEBUG [Listener at jenkins-hbase4.apache.org/36885] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-628947520_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:17,311 DEBUG [Listener at jenkins-hbase4.apache.org/36885] snapshot.TestExportSnapshot(367): hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-10-01 19:03:17,311 DEBUG [Listener at jenkins-hbase4.apache.org/36885] snapshot.TestExportSnapshot(367): hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-10-01 19:03:17,311 DEBUG [Listener at jenkins-hbase4.apache.org/36885] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-628947520_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/export-test/export-1696186984787/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/export-test/export-1696186984787/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:17,312 DEBUG [Listener at jenkins-hbase4.apache.org/36885] snapshot.TestExportSnapshot(367): hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/export-test/export-1696186984787/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-10-01 19:03:17,312 DEBUG [Listener at jenkins-hbase4.apache.org/36885] snapshot.TestExportSnapshot(367): hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/export-test/export-1696186984787/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-10-01 19:03:17,319 INFO [Listener at jenkins-hbase4.apache.org/36885] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:17,319 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:17,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] procedure2.ProcedureExecutor(1028): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:17,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-10-01 19:03:17,323 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696186997323"}]},"ts":"1696186997323"} 2023-10-01 19:03:17,325 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-10-01 19:03:17,326 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-10-01 19:03:17,327 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=cb9d3d213986d485e411b982b4398735, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9b954e7b768e48930e50db33f935fb02, UNASSIGN}] 2023-10-01 19:03:17,329 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=cb9d3d213986d485e411b982b4398735, UNASSIGN 2023-10-01 19:03:17,329 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9b954e7b768e48930e50db33f935fb02, UNASSIGN 2023-10-01 19:03:17,329 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=cb9d3d213986d485e411b982b4398735, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:03:17,330 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=9b954e7b768e48930e50db33f935fb02, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:03:17,330 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696186983476.cb9d3d213986d485e411b982b4398735.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696186997329"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696186997329"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696186997329"}]},"ts":"1696186997329"} 2023-10-01 19:03:17,330 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696186983476.9b954e7b768e48930e50db33f935fb02.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696186997330"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696186997330"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696186997330"}]},"ts":"1696186997330"} 2023-10-01 19:03:17,331 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure cb9d3d213986d485e411b982b4398735, server=jenkins-hbase4.apache.org,36507,1696186884612}] 2023-10-01 19:03:17,332 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure 9b954e7b768e48930e50db33f935fb02, server=jenkins-hbase4.apache.org,46609,1696186884566}] 2023-10-01 19:03:17,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-10-01 19:03:17,483 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close cb9d3d213986d485e411b982b4398735 2023-10-01 19:03:17,483 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing cb9d3d213986d485e411b982b4398735, disabling compactions & flushes 2023-10-01 19:03:17,483 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1696186983476.cb9d3d213986d485e411b982b4398735. 2023-10-01 19:03:17,483 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1696186983476.cb9d3d213986d485e411b982b4398735. 2023-10-01 19:03:17,483 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1696186983476.cb9d3d213986d485e411b982b4398735. after waiting 0 ms 2023-10-01 19:03:17,483 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1696186983476.cb9d3d213986d485e411b982b4398735. 2023-10-01 19:03:17,487 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 9b954e7b768e48930e50db33f935fb02 2023-10-01 19:03:17,487 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9b954e7b768e48930e50db33f935fb02, disabling compactions & flushes 2023-10-01 19:03:17,487 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1696186983476.9b954e7b768e48930e50db33f935fb02. 2023-10-01 19:03:17,487 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1696186983476.9b954e7b768e48930e50db33f935fb02. 2023-10-01 19:03:17,487 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1696186983476.9b954e7b768e48930e50db33f935fb02. after waiting 0 ms 2023-10-01 19:03:17,487 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1696186983476.9b954e7b768e48930e50db33f935fb02. 2023-10-01 19:03:17,496 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemStateWithSkipTmp/cb9d3d213986d485e411b982b4398735/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-01 19:03:17,496 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/default/testtb-testExportFileSystemStateWithSkipTmp/9b954e7b768e48930e50db33f935fb02/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-01 19:03:17,496 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 19:03:17,497 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1696186983476.cb9d3d213986d485e411b982b4398735. 2023-10-01 19:03:17,497 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for cb9d3d213986d485e411b982b4398735: 2023-10-01 19:03:17,497 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 19:03:17,498 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1696186983476.9b954e7b768e48930e50db33f935fb02. 2023-10-01 19:03:17,498 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9b954e7b768e48930e50db33f935fb02: 2023-10-01 19:03:17,499 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed cb9d3d213986d485e411b982b4398735 2023-10-01 19:03:17,499 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=cb9d3d213986d485e411b982b4398735, regionState=CLOSED 2023-10-01 19:03:17,500 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 9b954e7b768e48930e50db33f935fb02 2023-10-01 19:03:17,500 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696186983476.cb9d3d213986d485e411b982b4398735.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696186997499"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696186997499"}]},"ts":"1696186997499"} 2023-10-01 19:03:17,500 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=9b954e7b768e48930e50db33f935fb02, regionState=CLOSED 2023-10-01 19:03:17,500 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696186983476.9b954e7b768e48930e50db33f935fb02.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696186997500"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696186997500"}]},"ts":"1696186997500"} 2023-10-01 19:03:17,502 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=117, resume processing ppid=115 2023-10-01 19:03:17,502 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure cb9d3d213986d485e411b982b4398735, server=jenkins-hbase4.apache.org,36507,1696186884612 in 170 msec 2023-10-01 19:03:17,503 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=118, resume processing ppid=116 2023-10-01 19:03:17,503 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure 9b954e7b768e48930e50db33f935fb02, server=jenkins-hbase4.apache.org,46609,1696186884566 in 169 msec 2023-10-01 19:03:17,503 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=cb9d3d213986d485e411b982b4398735, UNASSIGN in 175 msec 2023-10-01 19:03:17,504 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=116, resume processing ppid=114 2023-10-01 19:03:17,504 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9b954e7b768e48930e50db33f935fb02, UNASSIGN in 176 msec 2023-10-01 19:03:17,505 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696186997505"}]},"ts":"1696186997505"} 2023-10-01 19:03:17,506 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-10-01 19:03:17,507 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-10-01 19:03:17,509 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 189 msec 2023-10-01 19:03:17,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-10-01 19:03:17,625 INFO [Listener at jenkins-hbase4.apache.org/36885] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-10-01 19:03:17,626 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:17,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] procedure2.ProcedureExecutor(1028): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:17,628 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:17,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:17,629 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:17,630 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36507] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:17,633 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/cb9d3d213986d485e411b982b4398735 2023-10-01 19:03:17,633 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9b954e7b768e48930e50db33f935fb02 2023-10-01 19:03:17,634 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:17,634 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:17,634 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:17,634 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:17,635 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-10-01 19:03:17,635 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-10-01 19:03:17,635 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-10-01 19:03:17,635 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9b954e7b768e48930e50db33f935fb02/cf, FileablePath, hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9b954e7b768e48930e50db33f935fb02/recovered.edits] 2023-10-01 19:03:17,635 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/cb9d3d213986d485e411b982b4398735/cf, FileablePath, hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/cb9d3d213986d485e411b982b4398735/recovered.edits] 2023-10-01 19:03:17,636 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 19:03:17,636 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:17,636 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 19:03:17,636 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:17,636 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data null 2023-10-01 19:03:17,636 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:17,636 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 19:03:17,636 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 19:03:17,636 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-01 19:03:17,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-10-01 19:03:17,640 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/cb9d3d213986d485e411b982b4398735/cf/1a4f207761ac4be5956f83a658563a2a to hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/cb9d3d213986d485e411b982b4398735/cf/1a4f207761ac4be5956f83a658563a2a 2023-10-01 19:03:17,640 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9b954e7b768e48930e50db33f935fb02/cf/61887aaa46da48929e93f13220a8150d to hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/9b954e7b768e48930e50db33f935fb02/cf/61887aaa46da48929e93f13220a8150d 2023-10-01 19:03:17,642 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/cb9d3d213986d485e411b982b4398735/recovered.edits/9.seqid to hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/cb9d3d213986d485e411b982b4398735/recovered.edits/9.seqid 2023-10-01 19:03:17,643 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9b954e7b768e48930e50db33f935fb02/recovered.edits/9.seqid to hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/9b954e7b768e48930e50db33f935fb02/recovered.edits/9.seqid 2023-10-01 19:03:17,643 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/cb9d3d213986d485e411b982b4398735 2023-10-01 19:03:17,643 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9b954e7b768e48930e50db33f935fb02 2023-10-01 19:03:17,643 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-10-01 19:03:17,644 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-10-01 19:03:17,644 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-10-01 19:03:17,648 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202310012a49a5900a0047f58e08ab22225fbfdb to hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202310012a49a5900a0047f58e08ab22225fbfdb 2023-10-01 19:03:17,649 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202310014516c888ce3f4366b450129374f8a83a to hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202310014516c888ce3f4366b450129374f8a83a 2023-10-01 19:03:17,649 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-10-01 19:03:17,651 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:17,653 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-10-01 19:03:17,655 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-10-01 19:03:17,655 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:17,655 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-10-01 19:03:17,656 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696186983476.cb9d3d213986d485e411b982b4398735.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696186997656"}]},"ts":"9223372036854775807"} 2023-10-01 19:03:17,656 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696186983476.9b954e7b768e48930e50db33f935fb02.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696186997656"}]},"ts":"9223372036854775807"} 2023-10-01 19:03:17,657 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-01 19:03:17,657 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => cb9d3d213986d485e411b982b4398735, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1696186983476.cb9d3d213986d485e411b982b4398735.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 9b954e7b768e48930e50db33f935fb02, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1696186983476.9b954e7b768e48930e50db33f935fb02.', STARTKEY => '1', ENDKEY => ''}] 2023-10-01 19:03:17,657 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-10-01 19:03:17,657 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696186997657"}]},"ts":"9223372036854775807"} 2023-10-01 19:03:17,660 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-10-01 19:03:17,662 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:17,663 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 36 msec 2023-10-01 19:03:17,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-10-01 19:03:17,738 INFO [Listener at jenkins-hbase4.apache.org/36885] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-10-01 19:03:17,745 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-10-01 19:03:17,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:17,748 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-10-01 19:03:17,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 19:03:17,773 INFO [Listener at jenkins-hbase4.apache.org/36885] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=767 (was 767), OpenFileDescriptor=911 (was 925), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=214 (was 236), ProcessCount=168 (was 168), AvailableMemoryMB=1000 (was 1073) 2023-10-01 19:03:17,773 WARN [Listener at jenkins-hbase4.apache.org/36885] hbase.ResourceChecker(130): Thread=767 is superior to 500 2023-10-01 19:03:17,773 INFO [Listener at jenkins-hbase4.apache.org/36885] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-10-01 19:03:17,783 INFO [Listener at jenkins-hbase4.apache.org/36885] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-10-01 19:03:17,894 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1696186890860_0007_01_000001 is : 143 2023-10-01 19:03:23,066 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-01 19:03:31,907 INFO [Listener at jenkins-hbase4.apache.org/36885] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-10-01 19:03:46,022 ERROR [Thread[Thread-409,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-10-01 19:03:46,022 INFO [Listener at jenkins-hbase4.apache.org/36885] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-10-01 19:03:46,131 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-10-01 19:03:46,140 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-10-01 19:03:46,141 ERROR [Thread[Thread-419,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-10-01 19:03:46,151 INFO [Listener at jenkins-hbase4.apache.org/36885] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-10-01 19:03:46,254 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-10-01 19:03:46,255 INFO [Listener at jenkins-hbase4.apache.org/36885] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-10-01 19:03:46,255 INFO [Listener at jenkins-hbase4.apache.org/36885] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-10-01 19:03:46,255 INFO [Listener at jenkins-hbase4.apache.org/36885] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-01 19:03:46,255 DEBUG [Listener at jenkins-hbase4.apache.org/36885] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7b3bae5a to 127.0.0.1:55462 2023-10-01 19:03:46,255 DEBUG [Listener at jenkins-hbase4.apache.org/36885] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 19:03:46,255 DEBUG [Listener at jenkins-hbase4.apache.org/36885] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-10-01 19:03:46,255 DEBUG [Listener at jenkins-hbase4.apache.org/36885] util.JVMClusterUtil(257): Found active master hash=1262805192, stopped=false 2023-10-01 19:03:46,255 DEBUG [Listener at jenkins-hbase4.apache.org/36885] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 19:03:46,256 DEBUG [Listener at jenkins-hbase4.apache.org/36885] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-10-01 19:03:46,256 INFO [Listener at jenkins-hbase4.apache.org/36885] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,42819,1696186883324 2023-10-01 19:03:46,258 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-01 19:03:46,258 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-01 19:03:46,258 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-01 19:03:46,258 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-01 19:03:46,258 INFO [Listener at jenkins-hbase4.apache.org/36885] procedure2.ProcedureExecutor(628): Stopping 2023-10-01 19:03:46,258 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-01 19:03:46,258 DEBUG [Listener at jenkins-hbase4.apache.org/36885] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x79c951d0 to 127.0.0.1:55462 2023-10-01 19:03:46,258 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-01 19:03:46,258 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-01 19:03:46,258 DEBUG [Listener at jenkins-hbase4.apache.org/36885] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 19:03:46,259 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-01 19:03:46,259 INFO [Listener at jenkins-hbase4.apache.org/36885] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,46609,1696186884566' ***** 2023-10-01 19:03:46,259 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-01 19:03:46,259 DEBUG [Listener at jenkins-hbase4.apache.org/36885] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 19:03:46,259 INFO [Listener at jenkins-hbase4.apache.org/36885] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-10-01 19:03:46,259 INFO [Listener at jenkins-hbase4.apache.org/36885] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,36507,1696186884612' ***** 2023-10-01 19:03:46,259 DEBUG [Listener at jenkins-hbase4.apache.org/36885] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 19:03:46,259 INFO [Listener at jenkins-hbase4.apache.org/36885] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-10-01 19:03:46,259 INFO [RS:0;jenkins-hbase4:46609] regionserver.HeapMemoryManager(220): Stopping 2023-10-01 19:03:46,259 INFO [Listener at jenkins-hbase4.apache.org/36885] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,44933,1696186884649' ***** 2023-10-01 19:03:46,260 INFO [RS:1;jenkins-hbase4:36507] regionserver.HeapMemoryManager(220): Stopping 2023-10-01 19:03:46,260 INFO [RS:0;jenkins-hbase4:46609] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-10-01 19:03:46,260 INFO [RS:1;jenkins-hbase4:36507] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-10-01 19:03:46,260 DEBUG [Listener at jenkins-hbase4.apache.org/36885] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 19:03:46,260 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-10-01 19:03:46,260 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-10-01 19:03:46,260 INFO [RS:1;jenkins-hbase4:36507] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-10-01 19:03:46,260 INFO [RS:0;jenkins-hbase4:46609] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-10-01 19:03:46,260 INFO [Listener at jenkins-hbase4.apache.org/36885] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-10-01 19:03:46,260 INFO [RS:0;jenkins-hbase4:46609] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:03:46,260 INFO [RS:1;jenkins-hbase4:36507] regionserver.HRegionServer(3305): Received CLOSE for 6be1c70a77aee64b46a6559a8da20c52 2023-10-01 19:03:46,260 DEBUG [RS:0;jenkins-hbase4:46609] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x61706be8 to 127.0.0.1:55462 2023-10-01 19:03:46,260 INFO [RS:2;jenkins-hbase4:44933] regionserver.HeapMemoryManager(220): Stopping 2023-10-01 19:03:46,260 DEBUG [RS:0;jenkins-hbase4:46609] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 19:03:46,260 INFO [RS:2;jenkins-hbase4:44933] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-10-01 19:03:46,260 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-10-01 19:03:46,263 INFO [RS:1;jenkins-hbase4:36507] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:03:46,263 INFO [RS:2;jenkins-hbase4:44933] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-10-01 19:03:46,263 DEBUG [RS:1;jenkins-hbase4:36507] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x34a97217 to 127.0.0.1:55462 2023-10-01 19:03:46,263 INFO [RS:0;jenkins-hbase4:46609] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,46609,1696186884566; all regions closed. 2023-10-01 19:03:46,263 INFO [RS:2;jenkins-hbase4:44933] regionserver.HRegionServer(3305): Received CLOSE for 1f6221aa17f01950b2b625187d3b00f5 2023-10-01 19:03:46,263 DEBUG [RS:1;jenkins-hbase4:36507] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 19:03:46,263 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6be1c70a77aee64b46a6559a8da20c52, disabling compactions & flushes 2023-10-01 19:03:46,265 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1f6221aa17f01950b2b625187d3b00f5, disabling compactions & flushes 2023-10-01 19:03:46,265 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1696186887481.6be1c70a77aee64b46a6559a8da20c52. 2023-10-01 19:03:46,264 INFO [RS:1;jenkins-hbase4:36507] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-10-01 19:03:46,264 INFO [RS:2;jenkins-hbase4:44933] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:03:46,265 DEBUG [RS:1;jenkins-hbase4:36507] regionserver.HRegionServer(1478): Online Regions={6be1c70a77aee64b46a6559a8da20c52=hbase:acl,,1696186887481.6be1c70a77aee64b46a6559a8da20c52.} 2023-10-01 19:03:46,265 DEBUG [RS:2;jenkins-hbase4:44933] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x36b1263b to 127.0.0.1:55462 2023-10-01 19:03:46,265 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1696186887481.6be1c70a77aee64b46a6559a8da20c52. 2023-10-01 19:03:46,265 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1696186886742.1f6221aa17f01950b2b625187d3b00f5. 2023-10-01 19:03:46,265 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1696186887481.6be1c70a77aee64b46a6559a8da20c52. after waiting 0 ms 2023-10-01 19:03:46,265 DEBUG [RS:2;jenkins-hbase4:44933] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 19:03:46,265 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1696186887481.6be1c70a77aee64b46a6559a8da20c52. 2023-10-01 19:03:46,265 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1696186886742.1f6221aa17f01950b2b625187d3b00f5. 2023-10-01 19:03:46,265 INFO [RS:2;jenkins-hbase4:44933] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-10-01 19:03:46,266 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 6be1c70a77aee64b46a6559a8da20c52 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-10-01 19:03:46,265 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1696186886742.1f6221aa17f01950b2b625187d3b00f5. after waiting 0 ms 2023-10-01 19:03:46,266 INFO [RS:2;jenkins-hbase4:44933] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-10-01 19:03:46,266 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1696186886742.1f6221aa17f01950b2b625187d3b00f5. 2023-10-01 19:03:46,266 INFO [RS:2;jenkins-hbase4:44933] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-10-01 19:03:46,266 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1f6221aa17f01950b2b625187d3b00f5 1/1 column families, dataSize=78 B heapSize=488 B 2023-10-01 19:03:46,266 INFO [RS:2;jenkins-hbase4:44933] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-10-01 19:03:46,266 DEBUG [RS:1;jenkins-hbase4:36507] regionserver.HRegionServer(1504): Waiting on 6be1c70a77aee64b46a6559a8da20c52 2023-10-01 19:03:46,266 INFO [RS:2;jenkins-hbase4:44933] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-10-01 19:03:46,266 DEBUG [RS:2;jenkins-hbase4:44933] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740, 1f6221aa17f01950b2b625187d3b00f5=hbase:namespace,,1696186886742.1f6221aa17f01950b2b625187d3b00f5.} 2023-10-01 19:03:46,267 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-10-01 19:03:46,267 DEBUG [RS:2;jenkins-hbase4:44933] regionserver.HRegionServer(1504): Waiting on 1588230740, 1f6221aa17f01950b2b625187d3b00f5 2023-10-01 19:03:46,267 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-10-01 19:03:46,267 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-10-01 19:03:46,267 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-10-01 19:03:46,267 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-10-01 19:03:46,267 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-10-01 19:03:46,286 DEBUG [RS:0;jenkins-hbase4:46609] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/oldWALs 2023-10-01 19:03:46,286 INFO [RS:0;jenkins-hbase4:46609] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C46609%2C1696186884566:(num 1696186886293) 2023-10-01 19:03:46,286 DEBUG [RS:0;jenkins-hbase4:46609] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 19:03:46,287 INFO [RS:0;jenkins-hbase4:46609] regionserver.LeaseManager(133): Closed leases 2023-10-01 19:03:46,295 INFO [RS:0;jenkins-hbase4:46609] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-10-01 19:03:46,295 INFO [RS:0;jenkins-hbase4:46609] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-10-01 19:03:46,295 INFO [RS:0;jenkins-hbase4:46609] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-10-01 19:03:46,295 INFO [RS:0;jenkins-hbase4:46609] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-10-01 19:03:46,295 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-01 19:03:46,297 INFO [RS:0;jenkins-hbase4:46609] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:46609 2023-10-01 19:03:46,297 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/hbase/namespace/1f6221aa17f01950b2b625187d3b00f5/.tmp/info/15cd6061c09b455da81c252de0f125f4 2023-10-01 19:03:46,301 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/hbase/acl/6be1c70a77aee64b46a6559a8da20c52/.tmp/l/eec041f6ab514850a3a82abfc01aa677 2023-10-01 19:03:46,303 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:03:46,303 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-01 19:03:46,303 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:03:46,303 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-01 19:03:46,303 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/hbase/meta/1588230740/.tmp/info/53db56caa5804bae8645aa603f2904b9 2023-10-01 19:03:46,303 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-01 19:03:46,303 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46609,1696186884566 2023-10-01 19:03:46,304 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-01 19:03:46,304 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,46609,1696186884566] 2023-10-01 19:03:46,305 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,46609,1696186884566; numProcessing=1 2023-10-01 19:03:46,305 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/hbase/namespace/1f6221aa17f01950b2b625187d3b00f5/.tmp/info/15cd6061c09b455da81c252de0f125f4 as hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/hbase/namespace/1f6221aa17f01950b2b625187d3b00f5/info/15cd6061c09b455da81c252de0f125f4 2023-10-01 19:03:46,306 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,46609,1696186884566 already deleted, retry=false 2023-10-01 19:03:46,306 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,46609,1696186884566 expired; onlineServers=2 2023-10-01 19:03:46,308 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for eec041f6ab514850a3a82abfc01aa677 2023-10-01 19:03:46,309 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/hbase/acl/6be1c70a77aee64b46a6559a8da20c52/.tmp/l/eec041f6ab514850a3a82abfc01aa677 as hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/hbase/acl/6be1c70a77aee64b46a6559a8da20c52/l/eec041f6ab514850a3a82abfc01aa677 2023-10-01 19:03:46,309 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 53db56caa5804bae8645aa603f2904b9 2023-10-01 19:03:46,310 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/hbase/namespace/1f6221aa17f01950b2b625187d3b00f5/info/15cd6061c09b455da81c252de0f125f4, entries=2, sequenceid=6, filesize=4.8 K 2023-10-01 19:03:46,311 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 1f6221aa17f01950b2b625187d3b00f5 in 45ms, sequenceid=6, compaction requested=false 2023-10-01 19:03:46,313 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for eec041f6ab514850a3a82abfc01aa677 2023-10-01 19:03:46,313 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/hbase/acl/6be1c70a77aee64b46a6559a8da20c52/l/eec041f6ab514850a3a82abfc01aa677, entries=7, sequenceid=18, filesize=5.2 K 2023-10-01 19:03:46,314 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 6be1c70a77aee64b46a6559a8da20c52 in 49ms, sequenceid=18, compaction requested=false 2023-10-01 19:03:46,329 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/hbase/meta/1588230740/.tmp/rep_barrier/f2536034e68e441b89a8321b8542b1e0 2023-10-01 19:03:46,329 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/hbase/namespace/1f6221aa17f01950b2b625187d3b00f5/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-01 19:03:46,330 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/hbase/acl/6be1c70a77aee64b46a6559a8da20c52/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-10-01 19:03:46,330 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 19:03:46,331 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1696186886742.1f6221aa17f01950b2b625187d3b00f5. 2023-10-01 19:03:46,331 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1f6221aa17f01950b2b625187d3b00f5: 2023-10-01 19:03:46,331 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1696186886742.1f6221aa17f01950b2b625187d3b00f5. 2023-10-01 19:03:46,331 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 19:03:46,332 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1696186887481.6be1c70a77aee64b46a6559a8da20c52. 2023-10-01 19:03:46,332 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6be1c70a77aee64b46a6559a8da20c52: 2023-10-01 19:03:46,332 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1696186887481.6be1c70a77aee64b46a6559a8da20c52. 2023-10-01 19:03:46,335 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f2536034e68e441b89a8321b8542b1e0 2023-10-01 19:03:46,340 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-10-01 19:03:46,340 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-10-01 19:03:46,340 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-10-01 19:03:46,345 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/hbase/meta/1588230740/.tmp/table/4161be44e6494938b2ef93e241acc797 2023-10-01 19:03:46,348 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4161be44e6494938b2ef93e241acc797 2023-10-01 19:03:46,349 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/hbase/meta/1588230740/.tmp/info/53db56caa5804bae8645aa603f2904b9 as hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/hbase/meta/1588230740/info/53db56caa5804bae8645aa603f2904b9 2023-10-01 19:03:46,353 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 53db56caa5804bae8645aa603f2904b9 2023-10-01 19:03:46,353 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/hbase/meta/1588230740/info/53db56caa5804bae8645aa603f2904b9, entries=48, sequenceid=131, filesize=10.3 K 2023-10-01 19:03:46,354 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/hbase/meta/1588230740/.tmp/rep_barrier/f2536034e68e441b89a8321b8542b1e0 as hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/hbase/meta/1588230740/rep_barrier/f2536034e68e441b89a8321b8542b1e0 2023-10-01 19:03:46,358 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f2536034e68e441b89a8321b8542b1e0 2023-10-01 19:03:46,358 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/hbase/meta/1588230740/rep_barrier/f2536034e68e441b89a8321b8542b1e0, entries=13, sequenceid=131, filesize=6.4 K 2023-10-01 19:03:46,358 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/hbase/meta/1588230740/.tmp/table/4161be44e6494938b2ef93e241acc797 as hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/hbase/meta/1588230740/table/4161be44e6494938b2ef93e241acc797 2023-10-01 19:03:46,362 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4161be44e6494938b2ef93e241acc797 2023-10-01 19:03:46,362 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/hbase/meta/1588230740/table/4161be44e6494938b2ef93e241acc797, entries=24, sequenceid=131, filesize=6.9 K 2023-10-01 19:03:46,363 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 96ms, sequenceid=131, compaction requested=false 2023-10-01 19:03:46,373 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-10-01 19:03:46,373 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 19:03:46,374 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-10-01 19:03:46,374 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-10-01 19:03:46,374 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-10-01 19:03:46,374 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-10-01 19:03:46,408 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-01 19:03:46,408 INFO [RS:0;jenkins-hbase4:46609] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,46609,1696186884566; zookeeper connection closed. 2023-10-01 19:03:46,408 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:46609-0x101035d10db0001, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-01 19:03:46,408 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5435e070] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5435e070 2023-10-01 19:03:46,466 INFO [RS:1;jenkins-hbase4:36507] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,36507,1696186884612; all regions closed. 2023-10-01 19:03:46,467 INFO [RS:2;jenkins-hbase4:44933] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,44933,1696186884649; all regions closed. 2023-10-01 19:03:46,473 DEBUG [RS:1;jenkins-hbase4:36507] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/oldWALs 2023-10-01 19:03:46,473 INFO [RS:1;jenkins-hbase4:36507] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C36507%2C1696186884612:(num 1696186886293) 2023-10-01 19:03:46,473 DEBUG [RS:1;jenkins-hbase4:36507] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 19:03:46,474 INFO [RS:1;jenkins-hbase4:36507] regionserver.LeaseManager(133): Closed leases 2023-10-01 19:03:46,474 INFO [RS:1;jenkins-hbase4:36507] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-10-01 19:03:46,474 INFO [RS:1;jenkins-hbase4:36507] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-10-01 19:03:46,474 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-01 19:03:46,474 INFO [RS:1;jenkins-hbase4:36507] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-10-01 19:03:46,475 INFO [RS:1;jenkins-hbase4:36507] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-10-01 19:03:46,475 DEBUG [RS:2;jenkins-hbase4:44933] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/oldWALs 2023-10-01 19:03:46,475 INFO [RS:1;jenkins-hbase4:36507] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:36507 2023-10-01 19:03:46,475 INFO [RS:2;jenkins-hbase4:44933] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44933%2C1696186884649.meta:.meta(num 1696186886434) 2023-10-01 19:03:46,480 DEBUG [RS:2;jenkins-hbase4:44933] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/oldWALs 2023-10-01 19:03:46,481 INFO [RS:2;jenkins-hbase4:44933] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44933%2C1696186884649:(num 1696186886293) 2023-10-01 19:03:46,481 DEBUG [RS:2;jenkins-hbase4:44933] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 19:03:46,481 INFO [RS:2;jenkins-hbase4:44933] regionserver.LeaseManager(133): Closed leases 2023-10-01 19:03:46,481 INFO [RS:2;jenkins-hbase4:44933] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-10-01 19:03:46,481 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-01 19:03:46,482 INFO [RS:2;jenkins-hbase4:44933] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44933 2023-10-01 19:03:46,482 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-01 19:03:46,482 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:03:46,482 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36507,1696186884612 2023-10-01 19:03:46,483 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:03:46,483 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44933,1696186884649 2023-10-01 19:03:46,484 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,44933,1696186884649] 2023-10-01 19:03:46,484 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,44933,1696186884649; numProcessing=2 2023-10-01 19:03:46,486 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,44933,1696186884649 already deleted, retry=false 2023-10-01 19:03:46,486 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,44933,1696186884649 expired; onlineServers=1 2023-10-01 19:03:46,486 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,36507,1696186884612] 2023-10-01 19:03:46,486 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,36507,1696186884612; numProcessing=3 2023-10-01 19:03:46,487 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,36507,1696186884612 already deleted, retry=false 2023-10-01 19:03:46,487 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,36507,1696186884612 expired; onlineServers=0 2023-10-01 19:03:46,487 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,42819,1696186883324' ***** 2023-10-01 19:03:46,487 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-10-01 19:03:46,487 DEBUG [M:0;jenkins-hbase4:42819] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@a79eaf3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-10-01 19:03:46,488 INFO [M:0;jenkins-hbase4:42819] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,42819,1696186883324 2023-10-01 19:03:46,488 INFO [M:0;jenkins-hbase4:42819] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,42819,1696186883324; all regions closed. 2023-10-01 19:03:46,488 DEBUG [M:0;jenkins-hbase4:42819] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 19:03:46,488 DEBUG [M:0;jenkins-hbase4:42819] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-10-01 19:03:46,488 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-10-01 19:03:46,488 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1696186885918] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1696186885918,5,FailOnTimeoutGroup] 2023-10-01 19:03:46,488 DEBUG [M:0;jenkins-hbase4:42819] cleaner.HFileCleaner(317): Stopping file delete threads 2023-10-01 19:03:46,488 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1696186885918] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1696186885918,5,FailOnTimeoutGroup] 2023-10-01 19:03:46,488 INFO [M:0;jenkins-hbase4:42819] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-10-01 19:03:46,488 INFO [M:0;jenkins-hbase4:42819] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-10-01 19:03:46,488 INFO [M:0;jenkins-hbase4:42819] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-10-01 19:03:46,488 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-10-01 19:03:46,488 DEBUG [M:0;jenkins-hbase4:42819] master.HMaster(1512): Stopping service threads 2023-10-01 19:03:46,488 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-01 19:03:46,489 INFO [M:0;jenkins-hbase4:42819] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-10-01 19:03:46,489 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-01 19:03:46,489 ERROR [M:0;jenkins-hbase4:42819] procedure2.ProcedureExecutor(652): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-13,5,PEWorkerGroup] Thread[HFileArchiver-15,5,PEWorkerGroup] 2023-10-01 19:03:46,490 INFO [M:0;jenkins-hbase4:42819] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-10-01 19:03:46,490 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-10-01 19:03:46,490 DEBUG [M:0;jenkins-hbase4:42819] zookeeper.ZKUtil(398): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-10-01 19:03:46,490 WARN [M:0;jenkins-hbase4:42819] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-10-01 19:03:46,490 INFO [M:0;jenkins-hbase4:42819] assignment.AssignmentManager(315): Stopping assignment manager 2023-10-01 19:03:46,490 INFO [M:0;jenkins-hbase4:42819] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-10-01 19:03:46,491 DEBUG [M:0;jenkins-hbase4:42819] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-10-01 19:03:46,491 INFO [M:0;jenkins-hbase4:42819] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-01 19:03:46,491 DEBUG [M:0;jenkins-hbase4:42819] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-01 19:03:46,491 DEBUG [M:0;jenkins-hbase4:42819] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-10-01 19:03:46,491 DEBUG [M:0;jenkins-hbase4:42819] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-01 19:03:46,491 INFO [M:0;jenkins-hbase4:42819] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.89 KB heapSize=452.12 KB 2023-10-01 19:03:46,505 INFO [M:0;jenkins-hbase4:42819] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.89 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/5e2a3c036fb04696939f6bfe176aaaf9 2023-10-01 19:03:46,508 INFO [M:0;jenkins-hbase4:42819] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5e2a3c036fb04696939f6bfe176aaaf9 2023-10-01 19:03:46,509 DEBUG [M:0;jenkins-hbase4:42819] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/5e2a3c036fb04696939f6bfe176aaaf9 as hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/5e2a3c036fb04696939f6bfe176aaaf9 2023-10-01 19:03:46,512 INFO [M:0;jenkins-hbase4:42819] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5e2a3c036fb04696939f6bfe176aaaf9 2023-10-01 19:03:46,513 INFO [M:0;jenkins-hbase4:42819] regionserver.HStore(1080): Added hdfs://localhost:38933/user/jenkins/test-data/bd042a0c-78ca-f322-209a-4f00429ce399/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/5e2a3c036fb04696939f6bfe176aaaf9, entries=119, sequenceid=899, filesize=28.7 K 2023-10-01 19:03:46,513 INFO [M:0;jenkins-hbase4:42819] regionserver.HRegion(2948): Finished flush of dataSize ~375.89 KB/384910, heapSize ~452.10 KB/462952, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 22ms, sequenceid=899, compaction requested=false 2023-10-01 19:03:46,515 INFO [M:0;jenkins-hbase4:42819] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-01 19:03:46,515 DEBUG [M:0;jenkins-hbase4:42819] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-10-01 19:03:46,518 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-01 19:03:46,518 INFO [M:0;jenkins-hbase4:42819] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-10-01 19:03:46,518 INFO [M:0;jenkins-hbase4:42819] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42819 2023-10-01 19:03:46,520 DEBUG [M:0;jenkins-hbase4:42819] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,42819,1696186883324 already deleted, retry=false 2023-10-01 19:03:46,584 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-01 19:03:46,584 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:36507-0x101035d10db0002, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-01 19:03:46,584 INFO [RS:1;jenkins-hbase4:36507] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,36507,1696186884612; zookeeper connection closed. 2023-10-01 19:03:46,585 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@3c3b5aa9] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@3c3b5aa9 2023-10-01 19:03:46,684 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-01 19:03:46,685 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): master:42819-0x101035d10db0000, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-01 19:03:46,685 INFO [M:0;jenkins-hbase4:42819] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,42819,1696186883324; zookeeper connection closed. 2023-10-01 19:03:46,785 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-01 19:03:46,785 DEBUG [Listener at localhost/37115-EventThread] zookeeper.ZKWatcher(600): regionserver:44933-0x101035d10db0003, quorum=127.0.0.1:55462, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-01 19:03:46,785 INFO [RS:2;jenkins-hbase4:44933] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,44933,1696186884649; zookeeper connection closed. 2023-10-01 19:03:46,785 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@13221dc3] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@13221dc3 2023-10-01 19:03:46,785 INFO [Listener at jenkins-hbase4.apache.org/36885] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-10-01 19:03:46,786 WARN [Listener at jenkins-hbase4.apache.org/36885] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-10-01 19:03:46,789 INFO [Listener at jenkins-hbase4.apache.org/36885] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-01 19:03:46,892 WARN [BP-975785596-172.31.14.131-1696186879628 heartbeating to localhost/127.0.0.1:38933] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-10-01 19:03:46,892 WARN [BP-975785596-172.31.14.131-1696186879628 heartbeating to localhost/127.0.0.1:38933] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-975785596-172.31.14.131-1696186879628 (Datanode Uuid 5a52128c-050b-4ac0-8887-45c12863a58d) service to localhost/127.0.0.1:38933 2023-10-01 19:03:46,894 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba/cluster_4acb6892-f4ef-d33f-00bc-9c8e7df86da3/dfs/data/data5/current/BP-975785596-172.31.14.131-1696186879628] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-01 19:03:46,894 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba/cluster_4acb6892-f4ef-d33f-00bc-9c8e7df86da3/dfs/data/data6/current/BP-975785596-172.31.14.131-1696186879628] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-01 19:03:46,895 WARN [Listener at jenkins-hbase4.apache.org/36885] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-10-01 19:03:46,897 INFO [Listener at jenkins-hbase4.apache.org/36885] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-01 19:03:47,000 WARN [BP-975785596-172.31.14.131-1696186879628 heartbeating to localhost/127.0.0.1:38933] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-10-01 19:03:47,000 WARN [BP-975785596-172.31.14.131-1696186879628 heartbeating to localhost/127.0.0.1:38933] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-975785596-172.31.14.131-1696186879628 (Datanode Uuid cbf73267-f011-4366-91ec-2a3433db4d22) service to localhost/127.0.0.1:38933 2023-10-01 19:03:47,000 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba/cluster_4acb6892-f4ef-d33f-00bc-9c8e7df86da3/dfs/data/data3/current/BP-975785596-172.31.14.131-1696186879628] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-01 19:03:47,001 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba/cluster_4acb6892-f4ef-d33f-00bc-9c8e7df86da3/dfs/data/data4/current/BP-975785596-172.31.14.131-1696186879628] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-01 19:03:47,002 WARN [Listener at jenkins-hbase4.apache.org/36885] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-10-01 19:03:47,004 INFO [Listener at jenkins-hbase4.apache.org/36885] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-01 19:03:47,106 WARN [BP-975785596-172.31.14.131-1696186879628 heartbeating to localhost/127.0.0.1:38933] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-10-01 19:03:47,106 WARN [BP-975785596-172.31.14.131-1696186879628 heartbeating to localhost/127.0.0.1:38933] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-975785596-172.31.14.131-1696186879628 (Datanode Uuid 7b92139c-413d-41f4-bfa4-697ef13e59cb) service to localhost/127.0.0.1:38933 2023-10-01 19:03:47,124 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba/cluster_4acb6892-f4ef-d33f-00bc-9c8e7df86da3/dfs/data/data1/current/BP-975785596-172.31.14.131-1696186879628] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-01 19:03:47,124 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cc63c45-073f-c379-123c-03f4ac3093ba/cluster_4acb6892-f4ef-d33f-00bc-9c8e7df86da3/dfs/data/data2/current/BP-975785596-172.31.14.131-1696186879628] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-01 19:03:47,145 INFO [Listener at jenkins-hbase4.apache.org/36885] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-01 19:03:47,270 INFO [Listener at jenkins-hbase4.apache.org/36885] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-10-01 19:03:47,353 INFO [Listener at jenkins-hbase4.apache.org/36885] hbase.HBaseTestingUtility(1293): Minicluster is down