2023-07-23 10:06:00,518 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-23 10:06:00,780 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f0c2d64d-3350-bc69-1c38-d6964a44400f 2023-07-23 10:06:00,781 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-07-23 10:06:00,781 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-07-23 10:06:00,820 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-23 10:06:01,054 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-23 10:06:01,055 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f0c2d64d-3350-bc69-1c38-d6964a44400f/cluster_e785ae9c-bfd7-c886-b4ec-cc83daa5c072, deleteOnExit=true 2023-07-23 10:06:01,055 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-23 10:06:01,055 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f0c2d64d-3350-bc69-1c38-d6964a44400f/test.cache.data in system properties and HBase conf 2023-07-23 10:06:01,056 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f0c2d64d-3350-bc69-1c38-d6964a44400f/hadoop.tmp.dir in system properties and HBase conf 2023-07-23 10:06:01,056 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f0c2d64d-3350-bc69-1c38-d6964a44400f/hadoop.log.dir in system properties and HBase conf 2023-07-23 10:06:01,057 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f0c2d64d-3350-bc69-1c38-d6964a44400f/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-23 10:06:01,057 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f0c2d64d-3350-bc69-1c38-d6964a44400f/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-23 10:06:01,057 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-23 10:06:01,403 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-23 10:06:01,410 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f0c2d64d-3350-bc69-1c38-d6964a44400f/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-23 10:06:01,411 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f0c2d64d-3350-bc69-1c38-d6964a44400f/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-23 10:06:01,412 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f0c2d64d-3350-bc69-1c38-d6964a44400f/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-23 10:06:01,412 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f0c2d64d-3350-bc69-1c38-d6964a44400f/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-23 10:06:01,412 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f0c2d64d-3350-bc69-1c38-d6964a44400f/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-23 10:06:01,413 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f0c2d64d-3350-bc69-1c38-d6964a44400f/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-23 10:06:01,416 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f0c2d64d-3350-bc69-1c38-d6964a44400f/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-23 10:06:01,418 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f0c2d64d-3350-bc69-1c38-d6964a44400f/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-23 10:06:01,418 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f0c2d64d-3350-bc69-1c38-d6964a44400f/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-23 10:06:01,419 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f0c2d64d-3350-bc69-1c38-d6964a44400f/nfs.dump.dir in system properties and HBase conf 2023-07-23 10:06:01,420 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f0c2d64d-3350-bc69-1c38-d6964a44400f/java.io.tmpdir in system properties and HBase conf 2023-07-23 10:06:01,420 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f0c2d64d-3350-bc69-1c38-d6964a44400f/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-23 10:06:01,420 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f0c2d64d-3350-bc69-1c38-d6964a44400f/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-23 10:06:01,421 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f0c2d64d-3350-bc69-1c38-d6964a44400f/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-23 10:06:02,038 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-23 10:06:02,042 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-23 10:06:02,319 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-23 10:06:02,499 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-23 10:06:02,511 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-23 10:06:02,545 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-23 10:06:02,577 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f0c2d64d-3350-bc69-1c38-d6964a44400f/java.io.tmpdir/Jetty_localhost_38507_hdfs____.785ucf/webapp 2023-07-23 10:06:02,750 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38507 2023-07-23 10:06:02,800 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-23 10:06:02,801 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-23 10:06:03,378 WARN [Listener at localhost/37479] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-23 10:06:03,461 WARN [Listener at localhost/37479] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-23 10:06:03,486 WARN [Listener at localhost/37479] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-23 10:06:03,494 INFO [Listener at localhost/37479] log.Slf4jLog(67): jetty-6.1.26 2023-07-23 10:06:03,506 INFO [Listener at localhost/37479] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f0c2d64d-3350-bc69-1c38-d6964a44400f/java.io.tmpdir/Jetty_localhost_38151_datanode____.rhd829/webapp 2023-07-23 10:06:03,691 INFO [Listener at localhost/37479] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38151 2023-07-23 10:06:04,194 WARN [Listener at localhost/36065] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-23 10:06:04,236 WARN [Listener at localhost/36065] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-23 10:06:04,246 WARN [Listener at localhost/36065] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-23 10:06:04,249 INFO [Listener at localhost/36065] log.Slf4jLog(67): jetty-6.1.26 2023-07-23 10:06:04,254 INFO [Listener at localhost/36065] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f0c2d64d-3350-bc69-1c38-d6964a44400f/java.io.tmpdir/Jetty_localhost_36079_datanode____.k1d3uy/webapp 2023-07-23 10:06:04,388 INFO [Listener at localhost/36065] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36079 2023-07-23 10:06:04,410 WARN [Listener at localhost/42419] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-23 10:06:04,547 WARN [Listener at localhost/42419] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-23 10:06:04,552 WARN [Listener at localhost/42419] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-23 10:06:04,554 INFO [Listener at localhost/42419] log.Slf4jLog(67): jetty-6.1.26 2023-07-23 10:06:04,561 INFO [Listener at localhost/42419] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f0c2d64d-3350-bc69-1c38-d6964a44400f/java.io.tmpdir/Jetty_localhost_41137_datanode____.tf5mxt/webapp 2023-07-23 10:06:04,726 INFO [Listener at localhost/42419] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41137 2023-07-23 10:06:04,776 WARN [Listener at localhost/45567] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-23 10:06:04,911 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x1bf94ff9bbd69078: Processing first storage report for DS-3866d0fa-2d63-4ab0-8bc7-a756284dc227 from datanode b8de142a-8a37-42a9-8af2-06bf50ff65b1 2023-07-23 10:06:04,912 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x1bf94ff9bbd69078: from storage DS-3866d0fa-2d63-4ab0-8bc7-a756284dc227 node DatanodeRegistration(127.0.0.1:46807, datanodeUuid=b8de142a-8a37-42a9-8af2-06bf50ff65b1, infoPort=36905, infoSecurePort=0, ipcPort=36065, storageInfo=lv=-57;cid=testClusterID;nsid=1870671723;c=1690106762112), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-23 10:06:04,913 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7892632eba76b444: Processing first storage report for DS-2410e61d-2fd0-47f8-bd71-ae1c76ac8ac5 from datanode 8fbd0bda-7ff5-470b-8e73-ab8afc9106c9 2023-07-23 10:06:04,913 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7892632eba76b444: from storage DS-2410e61d-2fd0-47f8-bd71-ae1c76ac8ac5 node DatanodeRegistration(127.0.0.1:42877, datanodeUuid=8fbd0bda-7ff5-470b-8e73-ab8afc9106c9, infoPort=41647, infoSecurePort=0, ipcPort=42419, storageInfo=lv=-57;cid=testClusterID;nsid=1870671723;c=1690106762112), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-23 10:06:04,913 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x1bf94ff9bbd69078: Processing first storage report for DS-1b01ac73-22af-49c4-8c7d-43a863c6a3ce from datanode b8de142a-8a37-42a9-8af2-06bf50ff65b1 2023-07-23 10:06:04,913 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x1bf94ff9bbd69078: from storage DS-1b01ac73-22af-49c4-8c7d-43a863c6a3ce node DatanodeRegistration(127.0.0.1:46807, datanodeUuid=b8de142a-8a37-42a9-8af2-06bf50ff65b1, infoPort=36905, infoSecurePort=0, ipcPort=36065, storageInfo=lv=-57;cid=testClusterID;nsid=1870671723;c=1690106762112), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-23 10:06:04,913 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7892632eba76b444: Processing first storage report for DS-32d95626-d54d-4707-8ae2-f3803ae2c012 from datanode 8fbd0bda-7ff5-470b-8e73-ab8afc9106c9 2023-07-23 10:06:04,913 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7892632eba76b444: from storage DS-32d95626-d54d-4707-8ae2-f3803ae2c012 node DatanodeRegistration(127.0.0.1:42877, datanodeUuid=8fbd0bda-7ff5-470b-8e73-ab8afc9106c9, infoPort=41647, infoSecurePort=0, ipcPort=42419, storageInfo=lv=-57;cid=testClusterID;nsid=1870671723;c=1690106762112), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-23 10:06:04,959 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x2bcff5760895b448: Processing first storage report for DS-cbc119c6-e79e-4484-9a98-d54a3a11d483 from datanode 37cc602f-d241-446f-938d-d9fb338e9fcb 2023-07-23 10:06:04,959 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x2bcff5760895b448: from storage DS-cbc119c6-e79e-4484-9a98-d54a3a11d483 node DatanodeRegistration(127.0.0.1:38609, datanodeUuid=37cc602f-d241-446f-938d-d9fb338e9fcb, infoPort=41473, infoSecurePort=0, ipcPort=45567, storageInfo=lv=-57;cid=testClusterID;nsid=1870671723;c=1690106762112), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-23 10:06:04,959 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x2bcff5760895b448: Processing first storage report for DS-134ec4a1-df3e-476f-8cf5-ad947b925a68 from datanode 37cc602f-d241-446f-938d-d9fb338e9fcb 2023-07-23 10:06:04,959 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x2bcff5760895b448: from storage DS-134ec4a1-df3e-476f-8cf5-ad947b925a68 node DatanodeRegistration(127.0.0.1:38609, datanodeUuid=37cc602f-d241-446f-938d-d9fb338e9fcb, infoPort=41473, infoSecurePort=0, ipcPort=45567, storageInfo=lv=-57;cid=testClusterID;nsid=1870671723;c=1690106762112), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-23 10:06:05,201 DEBUG [Listener at localhost/45567] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f0c2d64d-3350-bc69-1c38-d6964a44400f 2023-07-23 10:06:05,295 INFO [Listener at localhost/45567] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f0c2d64d-3350-bc69-1c38-d6964a44400f/cluster_e785ae9c-bfd7-c886-b4ec-cc83daa5c072/zookeeper_0, clientPort=55181, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f0c2d64d-3350-bc69-1c38-d6964a44400f/cluster_e785ae9c-bfd7-c886-b4ec-cc83daa5c072/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f0c2d64d-3350-bc69-1c38-d6964a44400f/cluster_e785ae9c-bfd7-c886-b4ec-cc83daa5c072/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-23 10:06:05,313 INFO [Listener at localhost/45567] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=55181 2023-07-23 10:06:05,325 INFO [Listener at localhost/45567] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-23 10:06:05,328 INFO [Listener at localhost/45567] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-23 10:06:06,035 INFO [Listener at localhost/45567] util.FSUtils(471): Created version file at hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528 with version=8 2023-07-23 10:06:06,035 INFO [Listener at localhost/45567] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/hbase-staging 2023-07-23 10:06:06,415 INFO [Listener at localhost/45567] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-23 10:06:07,021 INFO [Listener at localhost/45567] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-07-23 10:06:07,062 INFO [Listener at localhost/45567] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-23 10:06:07,063 INFO [Listener at localhost/45567] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-23 10:06:07,063 INFO [Listener at localhost/45567] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-23 10:06:07,063 INFO [Listener at localhost/45567] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-23 10:06:07,063 INFO [Listener at localhost/45567] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-23 10:06:07,229 INFO [Listener at localhost/45567] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-23 10:06:07,307 DEBUG [Listener at localhost/45567] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-23 10:06:07,416 INFO [Listener at localhost/45567] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34097 2023-07-23 10:06:07,432 INFO [Listener at localhost/45567] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-23 10:06:07,435 INFO [Listener at localhost/45567] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-23 10:06:07,466 INFO [Listener at localhost/45567] zookeeper.RecoverableZooKeeper(93): Process identifier=master:34097 connecting to ZooKeeper ensemble=127.0.0.1:55181 2023-07-23 10:06:07,529 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:340970x0, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-23 10:06:07,539 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:34097-0x10191a522dc0000 connected 2023-07-23 10:06:07,586 DEBUG [Listener at localhost/45567] zookeeper.ZKUtil(164): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-23 10:06:07,587 DEBUG [Listener at localhost/45567] zookeeper.ZKUtil(164): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-23 10:06:07,606 DEBUG [Listener at localhost/45567] zookeeper.ZKUtil(164): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-23 10:06:07,619 DEBUG [Listener at localhost/45567] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34097 2023-07-23 10:06:07,622 DEBUG [Listener at localhost/45567] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34097 2023-07-23 10:06:07,623 DEBUG [Listener at localhost/45567] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34097 2023-07-23 10:06:07,623 DEBUG [Listener at localhost/45567] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34097 2023-07-23 10:06:07,630 DEBUG [Listener at localhost/45567] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34097 2023-07-23 10:06:07,638 INFO [Listener at localhost/45567] master.HMaster(444): hbase.rootdir=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528, hbase.cluster.distributed=false 2023-07-23 10:06:07,730 INFO [Listener at localhost/45567] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-23 10:06:07,730 INFO [Listener at localhost/45567] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-23 10:06:07,730 INFO [Listener at localhost/45567] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-23 10:06:07,730 INFO [Listener at localhost/45567] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-23 10:06:07,731 INFO [Listener at localhost/45567] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-23 10:06:07,731 INFO [Listener at localhost/45567] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-23 10:06:07,738 INFO [Listener at localhost/45567] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-23 10:06:07,743 INFO [Listener at localhost/45567] ipc.NettyRpcServer(120): Bind to /172.31.14.131:36599 2023-07-23 10:06:07,746 INFO [Listener at localhost/45567] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-23 10:06:07,753 INFO [Listener at localhost/45567] mob.MobFileCache(124): MobFileCache disabled 2023-07-23 10:06:07,755 INFO [Listener at localhost/45567] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-23 10:06:07,757 INFO [Listener at localhost/45567] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-23 10:06:07,760 INFO [Listener at localhost/45567] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:36599 connecting to ZooKeeper ensemble=127.0.0.1:55181 2023-07-23 10:06:07,767 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:365990x0, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-23 10:06:07,767 DEBUG [Listener at localhost/45567] zookeeper.ZKUtil(164): regionserver:365990x0, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-23 10:06:07,768 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:36599-0x10191a522dc0001 connected 2023-07-23 10:06:07,771 DEBUG [Listener at localhost/45567] zookeeper.ZKUtil(164): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-23 10:06:07,774 DEBUG [Listener at localhost/45567] zookeeper.ZKUtil(164): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-23 10:06:07,776 DEBUG [Listener at localhost/45567] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36599 2023-07-23 10:06:07,778 DEBUG [Listener at localhost/45567] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36599 2023-07-23 10:06:07,782 DEBUG [Listener at localhost/45567] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36599 2023-07-23 10:06:07,786 DEBUG [Listener at localhost/45567] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36599 2023-07-23 10:06:07,786 DEBUG [Listener at localhost/45567] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36599 2023-07-23 10:06:07,800 INFO [Listener at localhost/45567] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-23 10:06:07,800 INFO [Listener at localhost/45567] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-23 10:06:07,801 INFO [Listener at localhost/45567] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-23 10:06:07,801 INFO [Listener at localhost/45567] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-23 10:06:07,801 INFO [Listener at localhost/45567] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-23 10:06:07,801 INFO [Listener at localhost/45567] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-23 10:06:07,801 INFO [Listener at localhost/45567] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-23 10:06:07,803 INFO [Listener at localhost/45567] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39563 2023-07-23 10:06:07,804 INFO [Listener at localhost/45567] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-23 10:06:07,807 INFO [Listener at localhost/45567] mob.MobFileCache(124): MobFileCache disabled 2023-07-23 10:06:07,807 INFO [Listener at localhost/45567] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-23 10:06:07,810 INFO [Listener at localhost/45567] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-23 10:06:07,814 INFO [Listener at localhost/45567] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:39563 connecting to ZooKeeper ensemble=127.0.0.1:55181 2023-07-23 10:06:07,818 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:395630x0, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-23 10:06:07,822 DEBUG [Listener at localhost/45567] zookeeper.ZKUtil(164): regionserver:395630x0, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-23 10:06:07,823 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:39563-0x10191a522dc0002 connected 2023-07-23 10:06:07,824 DEBUG [Listener at localhost/45567] zookeeper.ZKUtil(164): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-23 10:06:07,824 DEBUG [Listener at localhost/45567] zookeeper.ZKUtil(164): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-23 10:06:07,830 DEBUG [Listener at localhost/45567] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39563 2023-07-23 10:06:07,834 DEBUG [Listener at localhost/45567] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39563 2023-07-23 10:06:07,837 DEBUG [Listener at localhost/45567] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39563 2023-07-23 10:06:07,838 DEBUG [Listener at localhost/45567] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39563 2023-07-23 10:06:07,839 DEBUG [Listener at localhost/45567] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39563 2023-07-23 10:06:07,854 INFO [Listener at localhost/45567] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-23 10:06:07,854 INFO [Listener at localhost/45567] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-23 10:06:07,855 INFO [Listener at localhost/45567] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-23 10:06:07,855 INFO [Listener at localhost/45567] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-23 10:06:07,855 INFO [Listener at localhost/45567] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-23 10:06:07,855 INFO [Listener at localhost/45567] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-23 10:06:07,855 INFO [Listener at localhost/45567] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-23 10:06:07,857 INFO [Listener at localhost/45567] ipc.NettyRpcServer(120): Bind to /172.31.14.131:36827 2023-07-23 10:06:07,858 INFO [Listener at localhost/45567] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-23 10:06:07,862 INFO [Listener at localhost/45567] mob.MobFileCache(124): MobFileCache disabled 2023-07-23 10:06:07,864 INFO [Listener at localhost/45567] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-23 10:06:07,866 INFO [Listener at localhost/45567] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-23 10:06:07,870 INFO [Listener at localhost/45567] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:36827 connecting to ZooKeeper ensemble=127.0.0.1:55181 2023-07-23 10:06:07,874 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:368270x0, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-23 10:06:07,875 DEBUG [Listener at localhost/45567] zookeeper.ZKUtil(164): regionserver:368270x0, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-23 10:06:07,876 DEBUG [Listener at localhost/45567] zookeeper.ZKUtil(164): regionserver:368270x0, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-23 10:06:07,877 DEBUG [Listener at localhost/45567] zookeeper.ZKUtil(164): regionserver:368270x0, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-23 10:06:07,879 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:36827-0x10191a522dc0003 connected 2023-07-23 10:06:07,879 DEBUG [Listener at localhost/45567] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36827 2023-07-23 10:06:07,880 DEBUG [Listener at localhost/45567] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36827 2023-07-23 10:06:07,880 DEBUG [Listener at localhost/45567] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36827 2023-07-23 10:06:07,880 DEBUG [Listener at localhost/45567] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36827 2023-07-23 10:06:07,881 DEBUG [Listener at localhost/45567] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36827 2023-07-23 10:06:07,882 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,34097,1690106766220 2023-07-23 10:06:07,896 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-23 10:06:07,902 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,34097,1690106766220 2023-07-23 10:06:07,922 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-23 10:06:07,922 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-23 10:06:07,922 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-23 10:06:07,922 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-23 10:06:07,922 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-23 10:06:07,930 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-23 10:06:07,935 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,34097,1690106766220 from backup master directory 2023-07-23 10:06:07,935 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-23 10:06:07,942 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,34097,1690106766220 2023-07-23 10:06:07,942 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-23 10:06:07,943 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-23 10:06:07,943 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,34097,1690106766220 2023-07-23 10:06:07,946 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-23 10:06:07,948 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-23 10:06:08,060 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/hbase.id with ID: 94534eef-9ece-4f3e-8b92-ac4f9e7ec9d8 2023-07-23 10:06:08,109 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-23 10:06:08,126 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-23 10:06:08,192 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x636fe554 to 127.0.0.1:55181 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 10:06:08,230 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@204c378e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 10:06:08,257 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-23 10:06:08,260 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-23 10:06:08,282 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-23 10:06:08,283 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-23 10:06:08,285 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-23 10:06:08,291 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-23 10:06:08,292 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-23 10:06:08,344 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/MasterData/data/master/store-tmp 2023-07-23 10:06:08,399 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 10:06:08,399 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-23 10:06:08,399 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-23 10:06:08,399 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-23 10:06:08,399 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-23 10:06:08,399 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-23 10:06:08,400 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-23 10:06:08,400 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-23 10:06:08,401 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/MasterData/WALs/jenkins-hbase4.apache.org,34097,1690106766220 2023-07-23 10:06:08,433 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34097%2C1690106766220, suffix=, logDir=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/MasterData/WALs/jenkins-hbase4.apache.org,34097,1690106766220, archiveDir=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/MasterData/oldWALs, maxLogs=10 2023-07-23 10:06:08,518 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42877,DS-2410e61d-2fd0-47f8-bd71-ae1c76ac8ac5,DISK] 2023-07-23 10:06:08,518 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38609,DS-cbc119c6-e79e-4484-9a98-d54a3a11d483,DISK] 2023-07-23 10:06:08,518 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46807,DS-3866d0fa-2d63-4ab0-8bc7-a756284dc227,DISK] 2023-07-23 10:06:08,529 DEBUG [RS-EventLoopGroup-5-1] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-23 10:06:08,623 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/MasterData/WALs/jenkins-hbase4.apache.org,34097,1690106766220/jenkins-hbase4.apache.org%2C34097%2C1690106766220.1690106768448 2023-07-23 10:06:08,627 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38609,DS-cbc119c6-e79e-4484-9a98-d54a3a11d483,DISK], DatanodeInfoWithStorage[127.0.0.1:46807,DS-3866d0fa-2d63-4ab0-8bc7-a756284dc227,DISK], DatanodeInfoWithStorage[127.0.0.1:42877,DS-2410e61d-2fd0-47f8-bd71-ae1c76ac8ac5,DISK]] 2023-07-23 10:06:08,627 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-23 10:06:08,628 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 10:06:08,632 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-23 10:06:08,634 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-23 10:06:08,722 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-23 10:06:08,730 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-23 10:06:08,766 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-23 10:06:08,780 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 10:06:08,794 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-23 10:06:08,803 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-23 10:06:08,825 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-23 10:06:08,830 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 10:06:08,831 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59597790, jitterRate=-0.11192372441291809}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 10:06:08,831 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-23 10:06:08,832 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-23 10:06:08,856 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-23 10:06:08,856 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-23 10:06:08,858 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-23 10:06:08,860 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-23 10:06:08,899 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 38 msec 2023-07-23 10:06:08,899 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-23 10:06:08,933 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-23 10:06:08,939 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-23 10:06:08,967 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-23 10:06:08,971 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-23 10:06:08,973 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-23 10:06:08,978 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-23 10:06:08,982 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-23 10:06:08,985 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-23 10:06:08,988 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-23 10:06:08,989 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-23 10:06:09,006 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-23 10:06:09,013 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-23 10:06:09,013 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-23 10:06:09,014 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-23 10:06:09,014 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-23 10:06:09,014 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-23 10:06:09,015 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,34097,1690106766220, sessionid=0x10191a522dc0000, setting cluster-up flag (Was=false) 2023-07-23 10:06:09,036 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-23 10:06:09,044 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-23 10:06:09,047 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,34097,1690106766220 2023-07-23 10:06:09,053 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-23 10:06:09,060 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-23 10:06:09,062 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,34097,1690106766220 2023-07-23 10:06:09,066 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/.tmp 2023-07-23 10:06:09,093 INFO [RS:1;jenkins-hbase4:39563] regionserver.HRegionServer(951): ClusterId : 94534eef-9ece-4f3e-8b92-ac4f9e7ec9d8 2023-07-23 10:06:09,093 INFO [RS:0;jenkins-hbase4:36599] regionserver.HRegionServer(951): ClusterId : 94534eef-9ece-4f3e-8b92-ac4f9e7ec9d8 2023-07-23 10:06:09,095 INFO [RS:2;jenkins-hbase4:36827] regionserver.HRegionServer(951): ClusterId : 94534eef-9ece-4f3e-8b92-ac4f9e7ec9d8 2023-07-23 10:06:09,105 DEBUG [RS:0;jenkins-hbase4:36599] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-23 10:06:09,105 DEBUG [RS:2;jenkins-hbase4:36827] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-23 10:06:09,105 DEBUG [RS:1;jenkins-hbase4:39563] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-23 10:06:09,115 DEBUG [RS:2;jenkins-hbase4:36827] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-23 10:06:09,115 DEBUG [RS:2;jenkins-hbase4:36827] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-23 10:06:09,118 DEBUG [RS:1;jenkins-hbase4:39563] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-23 10:06:09,118 DEBUG [RS:1;jenkins-hbase4:39563] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-23 10:06:09,119 DEBUG [RS:0;jenkins-hbase4:36599] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-23 10:06:09,119 DEBUG [RS:0;jenkins-hbase4:36599] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-23 10:06:09,127 DEBUG [RS:0;jenkins-hbase4:36599] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-23 10:06:09,129 DEBUG [RS:0;jenkins-hbase4:36599] zookeeper.ReadOnlyZKClient(139): Connect 0x725e318c to 127.0.0.1:55181 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 10:06:09,131 DEBUG [RS:2;jenkins-hbase4:36827] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-23 10:06:09,131 DEBUG [RS:1;jenkins-hbase4:39563] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-23 10:06:09,147 DEBUG [RS:2;jenkins-hbase4:36827] zookeeper.ReadOnlyZKClient(139): Connect 0x12974ff8 to 127.0.0.1:55181 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 10:06:09,159 DEBUG [RS:1;jenkins-hbase4:39563] zookeeper.ReadOnlyZKClient(139): Connect 0x68e8f323 to 127.0.0.1:55181 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 10:06:09,220 DEBUG [RS:0;jenkins-hbase4:36599] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@745a7dcf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 10:06:09,222 DEBUG [RS:0;jenkins-hbase4:36599] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@32799d42, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-23 10:06:09,226 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-23 10:06:09,227 DEBUG [RS:2;jenkins-hbase4:36827] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6f95fa12, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 10:06:09,227 DEBUG [RS:2;jenkins-hbase4:36827] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6ae9a908, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-23 10:06:09,237 DEBUG [RS:1;jenkins-hbase4:39563] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@77a045ef, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 10:06:09,238 DEBUG [RS:1;jenkins-hbase4:39563] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3ceb01c5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-23 10:06:09,239 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 10:06:09,240 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-23 10:06:09,260 DEBUG [RS:0;jenkins-hbase4:36599] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:36599 2023-07-23 10:06:09,260 DEBUG [RS:1;jenkins-hbase4:39563] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:39563 2023-07-23 10:06:09,268 INFO [RS:0;jenkins-hbase4:36599] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-23 10:06:09,268 INFO [RS:1;jenkins-hbase4:39563] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-23 10:06:09,271 INFO [RS:1;jenkins-hbase4:39563] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-23 10:06:09,272 DEBUG [RS:1;jenkins-hbase4:39563] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-23 10:06:09,272 INFO [RS:0;jenkins-hbase4:36599] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-23 10:06:09,274 DEBUG [RS:0;jenkins-hbase4:36599] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-23 10:06:09,279 INFO [RS:1;jenkins-hbase4:39563] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 10:06:09,282 DEBUG [RS:1;jenkins-hbase4:39563] regionserver.HRegionServer(1022): About to register with Master. 2023-07-23 10:06:09,284 INFO [RS:0;jenkins-hbase4:36599] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 10:06:09,284 DEBUG [RS:0;jenkins-hbase4:36599] regionserver.HRegionServer(1022): About to register with Master. 2023-07-23 10:06:09,286 INFO [RS:1;jenkins-hbase4:39563] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,34097,1690106766220 with isa=jenkins-hbase4.apache.org/172.31.14.131:39563, startcode=1690106767800 2023-07-23 10:06:09,288 INFO [RS:0;jenkins-hbase4:36599] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,34097,1690106766220 with isa=jenkins-hbase4.apache.org/172.31.14.131:36599, startcode=1690106767729 2023-07-23 10:06:09,292 DEBUG [RS:2;jenkins-hbase4:36827] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:36827 2023-07-23 10:06:09,292 INFO [RS:2;jenkins-hbase4:36827] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-23 10:06:09,292 INFO [RS:2;jenkins-hbase4:36827] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-23 10:06:09,292 DEBUG [RS:2;jenkins-hbase4:36827] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-23 10:06:09,292 INFO [RS:2;jenkins-hbase4:36827] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 10:06:09,293 DEBUG [RS:2;jenkins-hbase4:36827] regionserver.HRegionServer(1022): About to register with Master. 2023-07-23 10:06:09,294 INFO [RS:2;jenkins-hbase4:36827] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,34097,1690106766220 with isa=jenkins-hbase4.apache.org/172.31.14.131:36827, startcode=1690106767853 2023-07-23 10:06:09,310 DEBUG [RS:0;jenkins-hbase4:36599] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-23 10:06:09,314 DEBUG [RS:1;jenkins-hbase4:39563] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-23 10:06:09,314 DEBUG [RS:2;jenkins-hbase4:36827] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-23 10:06:09,392 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-23 10:06:09,403 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-23 10:06:09,403 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-23 10:06:09,403 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-23 10:06:09,403 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-23 10:06:09,403 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-23 10:06:09,404 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 10:06:09,404 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-23 10:06:09,404 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 10:06:09,405 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44083, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-23 10:06:09,405 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55351, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-23 10:06:09,405 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44391, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-23 10:06:09,416 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1690106799416 2023-07-23 10:06:09,419 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-23 10:06:09,421 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34097] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-23 10:06:09,429 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-23 10:06:09,430 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-23 10:06:09,431 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34097] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-23 10:06:09,432 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34097] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-23 10:06:09,438 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-23 10:06:09,440 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-23 10:06:09,446 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-23 10:06:09,452 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-23 10:06:09,452 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-23 10:06:09,452 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-23 10:06:09,457 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-23 10:06:09,468 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-23 10:06:09,471 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-23 10:06:09,471 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-23 10:06:09,472 DEBUG [RS:2;jenkins-hbase4:36827] regionserver.HRegionServer(2830): Master is not running yet 2023-07-23 10:06:09,475 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-23 10:06:09,475 WARN [RS:2;jenkins-hbase4:36827] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-23 10:06:09,475 DEBUG [RS:0;jenkins-hbase4:36599] regionserver.HRegionServer(2830): Master is not running yet 2023-07-23 10:06:09,476 WARN [RS:0;jenkins-hbase4:36599] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-23 10:06:09,475 DEBUG [RS:1;jenkins-hbase4:39563] regionserver.HRegionServer(2830): Master is not running yet 2023-07-23 10:06:09,476 WARN [RS:1;jenkins-hbase4:39563] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-23 10:06:09,476 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-23 10:06:09,478 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1690106769478,5,FailOnTimeoutGroup] 2023-07-23 10:06:09,482 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1690106769479,5,FailOnTimeoutGroup] 2023-07-23 10:06:09,483 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-23 10:06:09,483 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-23 10:06:09,484 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-23 10:06:09,484 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-23 10:06:09,540 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-23 10:06:09,541 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-23 10:06:09,542 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528 2023-07-23 10:06:09,577 INFO [RS:2;jenkins-hbase4:36827] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,34097,1690106766220 with isa=jenkins-hbase4.apache.org/172.31.14.131:36827, startcode=1690106767853 2023-07-23 10:06:09,577 INFO [RS:0;jenkins-hbase4:36599] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,34097,1690106766220 with isa=jenkins-hbase4.apache.org/172.31.14.131:36599, startcode=1690106767729 2023-07-23 10:06:09,577 INFO [RS:1;jenkins-hbase4:39563] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,34097,1690106766220 with isa=jenkins-hbase4.apache.org/172.31.14.131:39563, startcode=1690106767800 2023-07-23 10:06:09,579 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 10:06:09,582 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-23 10:06:09,585 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34097] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:09,586 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/hbase/meta/1588230740/info 2023-07-23 10:06:09,587 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-23 10:06:09,588 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 10:06:09,589 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-23 10:06:09,593 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/hbase/meta/1588230740/rep_barrier 2023-07-23 10:06:09,593 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34097] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:09,599 DEBUG [RS:1;jenkins-hbase4:39563] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528 2023-07-23 10:06:09,600 DEBUG [RS:1;jenkins-hbase4:39563] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:37479 2023-07-23 10:06:09,600 DEBUG [RS:1;jenkins-hbase4:39563] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-23 10:06:09,600 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-23 10:06:09,600 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34097] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:09,602 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 10:06:09,603 DEBUG [RS:0;jenkins-hbase4:36599] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528 2023-07-23 10:06:09,603 DEBUG [RS:0;jenkins-hbase4:36599] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:37479 2023-07-23 10:06:09,603 DEBUG [RS:0;jenkins-hbase4:36599] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-23 10:06:09,607 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-23 10:06:09,607 DEBUG [RS:2;jenkins-hbase4:36827] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528 2023-07-23 10:06:09,607 DEBUG [RS:2;jenkins-hbase4:36827] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:37479 2023-07-23 10:06:09,607 DEBUG [RS:2;jenkins-hbase4:36827] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-23 10:06:09,610 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/hbase/meta/1588230740/table 2023-07-23 10:06:09,611 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-23 10:06:09,612 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 10:06:09,614 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/hbase/meta/1588230740 2023-07-23 10:06:09,615 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-23 10:06:09,615 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/hbase/meta/1588230740 2023-07-23 10:06:09,616 DEBUG [RS:2;jenkins-hbase4:36827] zookeeper.ZKUtil(162): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:09,616 WARN [RS:2;jenkins-hbase4:36827] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-23 10:06:09,616 DEBUG [RS:0;jenkins-hbase4:36599] zookeeper.ZKUtil(162): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:09,616 INFO [RS:2;jenkins-hbase4:36827] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-23 10:06:09,616 DEBUG [RS:2;jenkins-hbase4:36827] regionserver.HRegionServer(1948): logDir=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/WALs/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:09,617 DEBUG [RS:1;jenkins-hbase4:39563] zookeeper.ZKUtil(162): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:09,620 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-23 10:06:09,623 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-23 10:06:09,616 WARN [RS:0;jenkins-hbase4:36599] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-23 10:06:09,617 WARN [RS:1;jenkins-hbase4:39563] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-23 10:06:09,627 INFO [RS:0;jenkins-hbase4:36599] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-23 10:06:09,628 DEBUG [RS:0;jenkins-hbase4:36599] regionserver.HRegionServer(1948): logDir=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/WALs/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:09,627 INFO [RS:1;jenkins-hbase4:39563] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-23 10:06:09,630 DEBUG [RS:1;jenkins-hbase4:39563] regionserver.HRegionServer(1948): logDir=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/WALs/jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:09,631 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,36827,1690106767853] 2023-07-23 10:06:09,631 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,36599,1690106767729] 2023-07-23 10:06:09,631 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,39563,1690106767800] 2023-07-23 10:06:09,640 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 10:06:09,642 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58808501, jitterRate=-0.12368504703044891}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-23 10:06:09,642 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-23 10:06:09,642 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-23 10:06:09,642 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-23 10:06:09,642 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-23 10:06:09,642 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-23 10:06:09,642 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-23 10:06:09,649 DEBUG [RS:2;jenkins-hbase4:36827] zookeeper.ZKUtil(162): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:09,649 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-23 10:06:09,650 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-23 10:06:09,650 DEBUG [RS:2;jenkins-hbase4:36827] zookeeper.ZKUtil(162): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:09,651 DEBUG [RS:2;jenkins-hbase4:36827] zookeeper.ZKUtil(162): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:09,651 DEBUG [RS:0;jenkins-hbase4:36599] zookeeper.ZKUtil(162): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:09,651 DEBUG [RS:1;jenkins-hbase4:39563] zookeeper.ZKUtil(162): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:09,652 DEBUG [RS:0;jenkins-hbase4:36599] zookeeper.ZKUtil(162): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:09,653 DEBUG [RS:0;jenkins-hbase4:36599] zookeeper.ZKUtil(162): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:09,656 DEBUG [RS:1;jenkins-hbase4:39563] zookeeper.ZKUtil(162): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:09,657 DEBUG [RS:1;jenkins-hbase4:39563] zookeeper.ZKUtil(162): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:09,661 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-23 10:06:09,661 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-23 10:06:09,668 DEBUG [RS:0;jenkins-hbase4:36599] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-23 10:06:09,668 DEBUG [RS:2;jenkins-hbase4:36827] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-23 10:06:09,668 DEBUG [RS:1;jenkins-hbase4:39563] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-23 10:06:09,676 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-23 10:06:09,682 INFO [RS:2;jenkins-hbase4:36827] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-23 10:06:09,683 INFO [RS:1;jenkins-hbase4:39563] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-23 10:06:09,682 INFO [RS:0;jenkins-hbase4:36599] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-23 10:06:09,695 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-23 10:06:09,717 INFO [RS:0;jenkins-hbase4:36599] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-23 10:06:09,719 INFO [RS:1;jenkins-hbase4:39563] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-23 10:06:09,722 INFO [RS:2;jenkins-hbase4:36827] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-23 10:06:09,723 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-23 10:06:09,726 INFO [RS:2;jenkins-hbase4:36827] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-23 10:06:09,726 INFO [RS:2;jenkins-hbase4:36827] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-23 10:06:09,726 INFO [RS:0;jenkins-hbase4:36599] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-23 10:06:09,731 INFO [RS:1;jenkins-hbase4:39563] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-23 10:06:09,731 INFO [RS:0;jenkins-hbase4:36599] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-23 10:06:09,735 INFO [RS:1;jenkins-hbase4:39563] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-23 10:06:09,735 INFO [RS:2;jenkins-hbase4:36827] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-23 10:06:09,736 INFO [RS:0;jenkins-hbase4:36599] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-23 10:06:09,736 INFO [RS:1;jenkins-hbase4:39563] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-23 10:06:09,747 INFO [RS:2;jenkins-hbase4:36827] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-23 10:06:09,747 INFO [RS:1;jenkins-hbase4:39563] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-23 10:06:09,747 INFO [RS:0;jenkins-hbase4:36599] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-23 10:06:09,747 DEBUG [RS:2;jenkins-hbase4:36827] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 10:06:09,747 DEBUG [RS:1;jenkins-hbase4:39563] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 10:06:09,748 DEBUG [RS:2;jenkins-hbase4:36827] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 10:06:09,748 DEBUG [RS:0;jenkins-hbase4:36599] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 10:06:09,748 DEBUG [RS:2;jenkins-hbase4:36827] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 10:06:09,748 DEBUG [RS:0;jenkins-hbase4:36599] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 10:06:09,748 DEBUG [RS:2;jenkins-hbase4:36827] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 10:06:09,748 DEBUG [RS:0;jenkins-hbase4:36599] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 10:06:09,748 DEBUG [RS:2;jenkins-hbase4:36827] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 10:06:09,748 DEBUG [RS:0;jenkins-hbase4:36599] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 10:06:09,748 DEBUG [RS:2;jenkins-hbase4:36827] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-23 10:06:09,748 DEBUG [RS:0;jenkins-hbase4:36599] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 10:06:09,748 DEBUG [RS:2;jenkins-hbase4:36827] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 10:06:09,749 DEBUG [RS:0;jenkins-hbase4:36599] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-23 10:06:09,749 DEBUG [RS:2;jenkins-hbase4:36827] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 10:06:09,749 DEBUG [RS:0;jenkins-hbase4:36599] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 10:06:09,749 DEBUG [RS:2;jenkins-hbase4:36827] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 10:06:09,748 DEBUG [RS:1;jenkins-hbase4:39563] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 10:06:09,749 DEBUG [RS:2;jenkins-hbase4:36827] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 10:06:09,749 DEBUG [RS:0;jenkins-hbase4:36599] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 10:06:09,749 DEBUG [RS:1;jenkins-hbase4:39563] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 10:06:09,749 DEBUG [RS:0;jenkins-hbase4:36599] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 10:06:09,749 DEBUG [RS:1;jenkins-hbase4:39563] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 10:06:09,749 DEBUG [RS:0;jenkins-hbase4:36599] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 10:06:09,749 DEBUG [RS:1;jenkins-hbase4:39563] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 10:06:09,750 DEBUG [RS:1;jenkins-hbase4:39563] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-23 10:06:09,750 DEBUG [RS:1;jenkins-hbase4:39563] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 10:06:09,750 DEBUG [RS:1;jenkins-hbase4:39563] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 10:06:09,750 DEBUG [RS:1;jenkins-hbase4:39563] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 10:06:09,750 DEBUG [RS:1;jenkins-hbase4:39563] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 10:06:09,758 INFO [RS:2;jenkins-hbase4:36827] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-23 10:06:09,759 INFO [RS:2;jenkins-hbase4:36827] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-23 10:06:09,759 INFO [RS:2;jenkins-hbase4:36827] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-23 10:06:09,765 INFO [RS:1;jenkins-hbase4:39563] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-23 10:06:09,765 INFO [RS:1;jenkins-hbase4:39563] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-23 10:06:09,765 INFO [RS:1;jenkins-hbase4:39563] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-23 10:06:09,769 INFO [RS:0;jenkins-hbase4:36599] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-23 10:06:09,769 INFO [RS:0;jenkins-hbase4:36599] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-23 10:06:09,770 INFO [RS:0;jenkins-hbase4:36599] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-23 10:06:09,779 INFO [RS:2;jenkins-hbase4:36827] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-23 10:06:09,783 INFO [RS:1;jenkins-hbase4:39563] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-23 10:06:09,785 INFO [RS:1;jenkins-hbase4:39563] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39563,1690106767800-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-23 10:06:09,785 INFO [RS:2;jenkins-hbase4:36827] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36827,1690106767853-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-23 10:06:09,786 INFO [RS:0;jenkins-hbase4:36599] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-23 10:06:09,786 INFO [RS:0;jenkins-hbase4:36599] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36599,1690106767729-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-23 10:06:09,814 INFO [RS:1;jenkins-hbase4:39563] regionserver.Replication(203): jenkins-hbase4.apache.org,39563,1690106767800 started 2023-07-23 10:06:09,814 INFO [RS:1;jenkins-hbase4:39563] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,39563,1690106767800, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:39563, sessionid=0x10191a522dc0002 2023-07-23 10:06:09,814 DEBUG [RS:1;jenkins-hbase4:39563] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-23 10:06:09,815 DEBUG [RS:1;jenkins-hbase4:39563] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:09,815 DEBUG [RS:1;jenkins-hbase4:39563] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39563,1690106767800' 2023-07-23 10:06:09,815 DEBUG [RS:1;jenkins-hbase4:39563] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-23 10:06:09,815 DEBUG [RS:1;jenkins-hbase4:39563] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-23 10:06:09,816 DEBUG [RS:1;jenkins-hbase4:39563] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-23 10:06:09,816 DEBUG [RS:1;jenkins-hbase4:39563] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-23 10:06:09,816 DEBUG [RS:1;jenkins-hbase4:39563] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:09,816 DEBUG [RS:1;jenkins-hbase4:39563] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39563,1690106767800' 2023-07-23 10:06:09,816 DEBUG [RS:1;jenkins-hbase4:39563] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:06:09,817 DEBUG [RS:1;jenkins-hbase4:39563] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:06:09,818 DEBUG [RS:1;jenkins-hbase4:39563] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-23 10:06:09,818 INFO [RS:1;jenkins-hbase4:39563] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-23 10:06:09,818 INFO [RS:1;jenkins-hbase4:39563] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-23 10:06:09,821 INFO [RS:0;jenkins-hbase4:36599] regionserver.Replication(203): jenkins-hbase4.apache.org,36599,1690106767729 started 2023-07-23 10:06:09,821 INFO [RS:0;jenkins-hbase4:36599] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,36599,1690106767729, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:36599, sessionid=0x10191a522dc0001 2023-07-23 10:06:09,822 DEBUG [RS:0;jenkins-hbase4:36599] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-23 10:06:09,822 DEBUG [RS:0;jenkins-hbase4:36599] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:09,823 DEBUG [RS:0;jenkins-hbase4:36599] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36599,1690106767729' 2023-07-23 10:06:09,823 DEBUG [RS:0;jenkins-hbase4:36599] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-23 10:06:09,824 INFO [RS:2;jenkins-hbase4:36827] regionserver.Replication(203): jenkins-hbase4.apache.org,36827,1690106767853 started 2023-07-23 10:06:09,824 INFO [RS:2;jenkins-hbase4:36827] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,36827,1690106767853, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:36827, sessionid=0x10191a522dc0003 2023-07-23 10:06:09,824 DEBUG [RS:0;jenkins-hbase4:36599] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-23 10:06:09,824 DEBUG [RS:2;jenkins-hbase4:36827] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-23 10:06:09,824 DEBUG [RS:2;jenkins-hbase4:36827] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:09,825 DEBUG [RS:2;jenkins-hbase4:36827] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36827,1690106767853' 2023-07-23 10:06:09,825 DEBUG [RS:2;jenkins-hbase4:36827] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-23 10:06:09,825 DEBUG [RS:0;jenkins-hbase4:36599] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-23 10:06:09,825 DEBUG [RS:0;jenkins-hbase4:36599] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-23 10:06:09,825 DEBUG [RS:2;jenkins-hbase4:36827] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-23 10:06:09,825 DEBUG [RS:0;jenkins-hbase4:36599] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:09,826 DEBUG [RS:0;jenkins-hbase4:36599] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36599,1690106767729' 2023-07-23 10:06:09,826 DEBUG [RS:0;jenkins-hbase4:36599] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:06:09,827 DEBUG [RS:2;jenkins-hbase4:36827] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-23 10:06:09,828 DEBUG [RS:2;jenkins-hbase4:36827] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-23 10:06:09,828 DEBUG [RS:2;jenkins-hbase4:36827] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:09,828 DEBUG [RS:2;jenkins-hbase4:36827] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36827,1690106767853' 2023-07-23 10:06:09,828 DEBUG [RS:2;jenkins-hbase4:36827] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:06:09,827 DEBUG [RS:0;jenkins-hbase4:36599] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:06:09,828 DEBUG [RS:2;jenkins-hbase4:36827] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:06:09,828 DEBUG [RS:0;jenkins-hbase4:36599] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-23 10:06:09,828 INFO [RS:0;jenkins-hbase4:36599] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-23 10:06:09,829 INFO [RS:0;jenkins-hbase4:36599] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-23 10:06:09,829 DEBUG [RS:2;jenkins-hbase4:36827] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-23 10:06:09,830 INFO [RS:2;jenkins-hbase4:36827] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-23 10:06:09,830 INFO [RS:2;jenkins-hbase4:36827] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-23 10:06:09,875 DEBUG [jenkins-hbase4:34097] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-23 10:06:09,881 DEBUG [jenkins-hbase4:34097] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-23 10:06:09,896 DEBUG [jenkins-hbase4:34097] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-23 10:06:09,896 DEBUG [jenkins-hbase4:34097] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-23 10:06:09,896 DEBUG [jenkins-hbase4:34097] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-23 10:06:09,896 DEBUG [jenkins-hbase4:34097] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-23 10:06:09,900 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,39563,1690106767800, state=OPENING 2023-07-23 10:06:09,910 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-23 10:06:09,912 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-23 10:06:09,913 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-23 10:06:09,917 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,39563,1690106767800}] 2023-07-23 10:06:09,949 INFO [RS:1;jenkins-hbase4:39563] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39563%2C1690106767800, suffix=, logDir=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/WALs/jenkins-hbase4.apache.org,39563,1690106767800, archiveDir=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/oldWALs, maxLogs=32 2023-07-23 10:06:09,950 INFO [RS:2;jenkins-hbase4:36827] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36827%2C1690106767853, suffix=, logDir=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/WALs/jenkins-hbase4.apache.org,36827,1690106767853, archiveDir=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/oldWALs, maxLogs=32 2023-07-23 10:06:09,959 INFO [RS:0;jenkins-hbase4:36599] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36599%2C1690106767729, suffix=, logDir=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/WALs/jenkins-hbase4.apache.org,36599,1690106767729, archiveDir=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/oldWALs, maxLogs=32 2023-07-23 10:06:09,991 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42877,DS-2410e61d-2fd0-47f8-bd71-ae1c76ac8ac5,DISK] 2023-07-23 10:06:09,991 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46807,DS-3866d0fa-2d63-4ab0-8bc7-a756284dc227,DISK] 2023-07-23 10:06:09,991 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38609,DS-cbc119c6-e79e-4484-9a98-d54a3a11d483,DISK] 2023-07-23 10:06:10,060 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38609,DS-cbc119c6-e79e-4484-9a98-d54a3a11d483,DISK] 2023-07-23 10:06:10,060 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46807,DS-3866d0fa-2d63-4ab0-8bc7-a756284dc227,DISK] 2023-07-23 10:06:10,060 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42877,DS-2410e61d-2fd0-47f8-bd71-ae1c76ac8ac5,DISK] 2023-07-23 10:06:10,062 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38609,DS-cbc119c6-e79e-4484-9a98-d54a3a11d483,DISK] 2023-07-23 10:06:10,062 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42877,DS-2410e61d-2fd0-47f8-bd71-ae1c76ac8ac5,DISK] 2023-07-23 10:06:10,063 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46807,DS-3866d0fa-2d63-4ab0-8bc7-a756284dc227,DISK] 2023-07-23 10:06:10,070 INFO [RS:2;jenkins-hbase4:36827] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/WALs/jenkins-hbase4.apache.org,36827,1690106767853/jenkins-hbase4.apache.org%2C36827%2C1690106767853.1690106769956 2023-07-23 10:06:10,072 DEBUG [RS:2;jenkins-hbase4:36827] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38609,DS-cbc119c6-e79e-4484-9a98-d54a3a11d483,DISK], DatanodeInfoWithStorage[127.0.0.1:46807,DS-3866d0fa-2d63-4ab0-8bc7-a756284dc227,DISK], DatanodeInfoWithStorage[127.0.0.1:42877,DS-2410e61d-2fd0-47f8-bd71-ae1c76ac8ac5,DISK]] 2023-07-23 10:06:10,083 INFO [RS:0;jenkins-hbase4:36599] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/WALs/jenkins-hbase4.apache.org,36599,1690106767729/jenkins-hbase4.apache.org%2C36599%2C1690106767729.1690106769960 2023-07-23 10:06:10,085 INFO [RS:1;jenkins-hbase4:39563] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/WALs/jenkins-hbase4.apache.org,39563,1690106767800/jenkins-hbase4.apache.org%2C39563%2C1690106767800.1690106769957 2023-07-23 10:06:10,086 DEBUG [RS:0;jenkins-hbase4:36599] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42877,DS-2410e61d-2fd0-47f8-bd71-ae1c76ac8ac5,DISK], DatanodeInfoWithStorage[127.0.0.1:46807,DS-3866d0fa-2d63-4ab0-8bc7-a756284dc227,DISK], DatanodeInfoWithStorage[127.0.0.1:38609,DS-cbc119c6-e79e-4484-9a98-d54a3a11d483,DISK]] 2023-07-23 10:06:10,087 DEBUG [RS:1;jenkins-hbase4:39563] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46807,DS-3866d0fa-2d63-4ab0-8bc7-a756284dc227,DISK], DatanodeInfoWithStorage[127.0.0.1:38609,DS-cbc119c6-e79e-4484-9a98-d54a3a11d483,DISK], DatanodeInfoWithStorage[127.0.0.1:42877,DS-2410e61d-2fd0-47f8-bd71-ae1c76ac8ac5,DISK]] 2023-07-23 10:06:10,139 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:10,147 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-23 10:06:10,156 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48848, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-23 10:06:10,187 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-23 10:06:10,187 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-23 10:06:10,194 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39563%2C1690106767800.meta, suffix=.meta, logDir=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/WALs/jenkins-hbase4.apache.org,39563,1690106767800, archiveDir=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/oldWALs, maxLogs=32 2023-07-23 10:06:10,225 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46807,DS-3866d0fa-2d63-4ab0-8bc7-a756284dc227,DISK] 2023-07-23 10:06:10,229 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38609,DS-cbc119c6-e79e-4484-9a98-d54a3a11d483,DISK] 2023-07-23 10:06:10,230 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42877,DS-2410e61d-2fd0-47f8-bd71-ae1c76ac8ac5,DISK] 2023-07-23 10:06:10,240 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/WALs/jenkins-hbase4.apache.org,39563,1690106767800/jenkins-hbase4.apache.org%2C39563%2C1690106767800.meta.1690106770196.meta 2023-07-23 10:06:10,242 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46807,DS-3866d0fa-2d63-4ab0-8bc7-a756284dc227,DISK], DatanodeInfoWithStorage[127.0.0.1:38609,DS-cbc119c6-e79e-4484-9a98-d54a3a11d483,DISK], DatanodeInfoWithStorage[127.0.0.1:42877,DS-2410e61d-2fd0-47f8-bd71-ae1c76ac8ac5,DISK]] 2023-07-23 10:06:10,242 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-23 10:06:10,243 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-23 10:06:10,245 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 10:06:10,246 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-23 10:06:10,248 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-23 10:06:10,249 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-23 10:06:10,263 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-23 10:06:10,263 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 10:06:10,263 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-23 10:06:10,263 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-23 10:06:10,266 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-23 10:06:10,268 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/hbase/meta/1588230740/info 2023-07-23 10:06:10,268 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/hbase/meta/1588230740/info 2023-07-23 10:06:10,269 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-23 10:06:10,269 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 10:06:10,270 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-23 10:06:10,272 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/hbase/meta/1588230740/rep_barrier 2023-07-23 10:06:10,272 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/hbase/meta/1588230740/rep_barrier 2023-07-23 10:06:10,272 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-23 10:06:10,273 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 10:06:10,273 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-23 10:06:10,275 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/hbase/meta/1588230740/table 2023-07-23 10:06:10,275 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/hbase/meta/1588230740/table 2023-07-23 10:06:10,276 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-23 10:06:10,277 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 10:06:10,279 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/hbase/meta/1588230740 2023-07-23 10:06:10,282 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/hbase/meta/1588230740 2023-07-23 10:06:10,285 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-23 10:06:10,288 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-23 10:06:10,289 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62224292, jitterRate=-0.07278579473495483}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-23 10:06:10,292 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-23 10:06:10,302 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1690106770127 2023-07-23 10:06:10,323 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-23 10:06:10,324 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-23 10:06:10,325 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,39563,1690106767800, state=OPEN 2023-07-23 10:06:10,328 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-23 10:06:10,328 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-23 10:06:10,332 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-23 10:06:10,332 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,39563,1690106767800 in 412 msec 2023-07-23 10:06:10,338 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-23 10:06:10,338 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 658 msec 2023-07-23 10:06:10,344 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.0930 sec 2023-07-23 10:06:10,344 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1690106770344, completionTime=-1 2023-07-23 10:06:10,344 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-23 10:06:10,344 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-23 10:06:10,421 DEBUG [hconnection-0x3cfc6090-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 10:06:10,427 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60974, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 10:06:10,450 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-23 10:06:10,450 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1690106830450 2023-07-23 10:06:10,450 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1690106890450 2023-07-23 10:06:10,451 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 106 msec 2023-07-23 10:06:10,479 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34097,1690106766220-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-23 10:06:10,480 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34097,1690106766220-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-23 10:06:10,480 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34097,1690106766220-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-23 10:06:10,483 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:34097, period=300000, unit=MILLISECONDS is enabled. 2023-07-23 10:06:10,483 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-23 10:06:10,492 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-23 10:06:10,501 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-23 10:06:10,502 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-23 10:06:10,513 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-23 10:06:10,517 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-23 10:06:10,521 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-23 10:06:10,548 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/hbase/namespace/4b59e3c0171366eb285c3dc1e37b4112 2023-07-23 10:06:10,551 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/hbase/namespace/4b59e3c0171366eb285c3dc1e37b4112 empty. 2023-07-23 10:06:10,552 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/hbase/namespace/4b59e3c0171366eb285c3dc1e37b4112 2023-07-23 10:06:10,552 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-23 10:06:10,601 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-23 10:06:10,605 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 4b59e3c0171366eb285c3dc1e37b4112, NAME => 'hbase:namespace,,1690106770502.4b59e3c0171366eb285c3dc1e37b4112.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp 2023-07-23 10:06:10,633 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1690106770502.4b59e3c0171366eb285c3dc1e37b4112.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 10:06:10,633 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 4b59e3c0171366eb285c3dc1e37b4112, disabling compactions & flushes 2023-07-23 10:06:10,633 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1690106770502.4b59e3c0171366eb285c3dc1e37b4112. 2023-07-23 10:06:10,633 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1690106770502.4b59e3c0171366eb285c3dc1e37b4112. 2023-07-23 10:06:10,633 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1690106770502.4b59e3c0171366eb285c3dc1e37b4112. after waiting 0 ms 2023-07-23 10:06:10,633 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1690106770502.4b59e3c0171366eb285c3dc1e37b4112. 2023-07-23 10:06:10,633 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1690106770502.4b59e3c0171366eb285c3dc1e37b4112. 2023-07-23 10:06:10,633 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 4b59e3c0171366eb285c3dc1e37b4112: 2023-07-23 10:06:10,640 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-23 10:06:10,657 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1690106770502.4b59e3c0171366eb285c3dc1e37b4112.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690106770644"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690106770644"}]},"ts":"1690106770644"} 2023-07-23 10:06:10,692 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-23 10:06:10,699 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-23 10:06:10,704 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690106770699"}]},"ts":"1690106770699"} 2023-07-23 10:06:10,710 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-23 10:06:10,715 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-23 10:06:10,716 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-23 10:06:10,716 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-23 10:06:10,716 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-23 10:06:10,716 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-23 10:06:10,719 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=4b59e3c0171366eb285c3dc1e37b4112, ASSIGN}] 2023-07-23 10:06:10,723 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=4b59e3c0171366eb285c3dc1e37b4112, ASSIGN 2023-07-23 10:06:10,724 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=4b59e3c0171366eb285c3dc1e37b4112, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36827,1690106767853; forceNewPlan=false, retain=false 2023-07-23 10:06:10,877 INFO [jenkins-hbase4:34097] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-23 10:06:10,879 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=4b59e3c0171366eb285c3dc1e37b4112, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:10,879 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1690106770502.4b59e3c0171366eb285c3dc1e37b4112.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690106770878"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690106770878"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690106770878"}]},"ts":"1690106770878"} 2023-07-23 10:06:10,889 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 4b59e3c0171366eb285c3dc1e37b4112, server=jenkins-hbase4.apache.org,36827,1690106767853}] 2023-07-23 10:06:11,044 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:11,045 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-23 10:06:11,048 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59366, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-23 10:06:11,058 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1690106770502.4b59e3c0171366eb285c3dc1e37b4112. 2023-07-23 10:06:11,058 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4b59e3c0171366eb285c3dc1e37b4112, NAME => 'hbase:namespace,,1690106770502.4b59e3c0171366eb285c3dc1e37b4112.', STARTKEY => '', ENDKEY => ''} 2023-07-23 10:06:11,059 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1690106770502.4b59e3c0171366eb285c3dc1e37b4112. service=AccessControlService 2023-07-23 10:06:11,060 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 10:06:11,061 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 4b59e3c0171366eb285c3dc1e37b4112 2023-07-23 10:06:11,061 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1690106770502.4b59e3c0171366eb285c3dc1e37b4112.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 10:06:11,061 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4b59e3c0171366eb285c3dc1e37b4112 2023-07-23 10:06:11,061 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4b59e3c0171366eb285c3dc1e37b4112 2023-07-23 10:06:11,063 INFO [StoreOpener-4b59e3c0171366eb285c3dc1e37b4112-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 4b59e3c0171366eb285c3dc1e37b4112 2023-07-23 10:06:11,066 DEBUG [StoreOpener-4b59e3c0171366eb285c3dc1e37b4112-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/hbase/namespace/4b59e3c0171366eb285c3dc1e37b4112/info 2023-07-23 10:06:11,066 DEBUG [StoreOpener-4b59e3c0171366eb285c3dc1e37b4112-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/hbase/namespace/4b59e3c0171366eb285c3dc1e37b4112/info 2023-07-23 10:06:11,067 INFO [StoreOpener-4b59e3c0171366eb285c3dc1e37b4112-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4b59e3c0171366eb285c3dc1e37b4112 columnFamilyName info 2023-07-23 10:06:11,068 INFO [StoreOpener-4b59e3c0171366eb285c3dc1e37b4112-1] regionserver.HStore(310): Store=4b59e3c0171366eb285c3dc1e37b4112/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 10:06:11,070 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/hbase/namespace/4b59e3c0171366eb285c3dc1e37b4112 2023-07-23 10:06:11,071 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/hbase/namespace/4b59e3c0171366eb285c3dc1e37b4112 2023-07-23 10:06:11,081 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4b59e3c0171366eb285c3dc1e37b4112 2023-07-23 10:06:11,086 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/hbase/namespace/4b59e3c0171366eb285c3dc1e37b4112/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 10:06:11,087 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4b59e3c0171366eb285c3dc1e37b4112; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62560011, jitterRate=-0.06778319180011749}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 10:06:11,087 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4b59e3c0171366eb285c3dc1e37b4112: 2023-07-23 10:06:11,089 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1690106770502.4b59e3c0171366eb285c3dc1e37b4112., pid=6, masterSystemTime=1690106771044 2023-07-23 10:06:11,094 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1690106770502.4b59e3c0171366eb285c3dc1e37b4112. 2023-07-23 10:06:11,094 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1690106770502.4b59e3c0171366eb285c3dc1e37b4112. 2023-07-23 10:06:11,096 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=4b59e3c0171366eb285c3dc1e37b4112, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:11,096 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1690106770502.4b59e3c0171366eb285c3dc1e37b4112.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690106771096"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690106771096"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690106771096"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690106771096"}]},"ts":"1690106771096"} 2023-07-23 10:06:11,106 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-23 10:06:11,106 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 4b59e3c0171366eb285c3dc1e37b4112, server=jenkins-hbase4.apache.org,36827,1690106767853 in 211 msec 2023-07-23 10:06:11,109 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-23 10:06:11,110 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=4b59e3c0171366eb285c3dc1e37b4112, ASSIGN in 387 msec 2023-07-23 10:06:11,111 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-23 10:06:11,111 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690106771111"}]},"ts":"1690106771111"} 2023-07-23 10:06:11,114 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-23 10:06:11,117 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-23 10:06:11,117 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-23 10:06:11,118 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-23 10:06:11,118 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-23 10:06:11,119 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 614 msec 2023-07-23 10:06:11,140 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 10:06:11,142 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59376, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 10:06:11,156 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-23 10:06:11,172 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-23 10:06:11,178 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 29 msec 2023-07-23 10:06:11,189 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-23 10:06:11,199 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-23 10:06:11,204 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 14 msec 2023-07-23 10:06:11,215 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-23 10:06:11,217 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-23 10:06:11,217 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.274sec 2023-07-23 10:06:11,220 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-23 10:06:11,222 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-23 10:06:11,222 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-23 10:06:11,223 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34097,1690106766220-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-23 10:06:11,224 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34097,1690106766220-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-23 10:06:11,245 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-23 10:06:11,247 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-23 10:06:11,249 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-23 10:06:11,250 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-23 10:06:11,253 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/hbase/acl/eaf9a3ac32c2b3d5414d70aa7cd9cde4 2023-07-23 10:06:11,253 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-23 10:06:11,254 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/hbase/acl/eaf9a3ac32c2b3d5414d70aa7cd9cde4 empty. 2023-07-23 10:06:11,256 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/hbase/acl/eaf9a3ac32c2b3d5414d70aa7cd9cde4 2023-07-23 10:06:11,257 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-23 10:06:11,262 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-23 10:06:11,279 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-23 10:06:11,281 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => eaf9a3ac32c2b3d5414d70aa7cd9cde4, NAME => 'hbase:acl,,1690106771241.eaf9a3ac32c2b3d5414d70aa7cd9cde4.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp 2023-07-23 10:06:11,300 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1690106771241.eaf9a3ac32c2b3d5414d70aa7cd9cde4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 10:06:11,300 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing eaf9a3ac32c2b3d5414d70aa7cd9cde4, disabling compactions & flushes 2023-07-23 10:06:11,300 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1690106771241.eaf9a3ac32c2b3d5414d70aa7cd9cde4. 2023-07-23 10:06:11,300 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1690106771241.eaf9a3ac32c2b3d5414d70aa7cd9cde4. 2023-07-23 10:06:11,300 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1690106771241.eaf9a3ac32c2b3d5414d70aa7cd9cde4. after waiting 0 ms 2023-07-23 10:06:11,300 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1690106771241.eaf9a3ac32c2b3d5414d70aa7cd9cde4. 2023-07-23 10:06:11,300 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1690106771241.eaf9a3ac32c2b3d5414d70aa7cd9cde4. 2023-07-23 10:06:11,300 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for eaf9a3ac32c2b3d5414d70aa7cd9cde4: 2023-07-23 10:06:11,301 DEBUG [Listener at localhost/45567] zookeeper.ReadOnlyZKClient(139): Connect 0x207f6c1a to 127.0.0.1:55181 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 10:06:11,305 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-23 10:06:11,308 DEBUG [Listener at localhost/45567] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@35faf608, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 10:06:11,308 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1690106771241.eaf9a3ac32c2b3d5414d70aa7cd9cde4.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1690106771308"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690106771308"}]},"ts":"1690106771308"} 2023-07-23 10:06:11,311 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-23 10:06:11,313 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-23 10:06:11,314 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690106771314"}]},"ts":"1690106771314"} 2023-07-23 10:06:11,316 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-23 10:06:11,321 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-23 10:06:11,321 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-23 10:06:11,322 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-23 10:06:11,322 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-23 10:06:11,322 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-23 10:06:11,322 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=eaf9a3ac32c2b3d5414d70aa7cd9cde4, ASSIGN}] 2023-07-23 10:06:11,322 DEBUG [hconnection-0x4f1da2dd-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 10:06:11,324 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=eaf9a3ac32c2b3d5414d70aa7cd9cde4, ASSIGN 2023-07-23 10:06:11,327 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=eaf9a3ac32c2b3d5414d70aa7cd9cde4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39563,1690106767800; forceNewPlan=false, retain=false 2023-07-23 10:06:11,334 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60984, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 10:06:11,337 INFO [Listener at localhost/45567] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,34097,1690106766220 2023-07-23 10:06:11,337 INFO [Listener at localhost/45567] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-23 10:06:11,337 INFO [Listener at localhost/45567] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f0c2d64d-3350-bc69-1c38-d6964a44400f/test.cache.data in system properties and HBase conf 2023-07-23 10:06:11,337 INFO [Listener at localhost/45567] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f0c2d64d-3350-bc69-1c38-d6964a44400f/hadoop.tmp.dir in system properties and HBase conf 2023-07-23 10:06:11,337 INFO [Listener at localhost/45567] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f0c2d64d-3350-bc69-1c38-d6964a44400f/hadoop.log.dir in system properties and HBase conf 2023-07-23 10:06:11,338 INFO [Listener at localhost/45567] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f0c2d64d-3350-bc69-1c38-d6964a44400f/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-23 10:06:11,338 INFO [Listener at localhost/45567] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f0c2d64d-3350-bc69-1c38-d6964a44400f/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-23 10:06:11,338 INFO [Listener at localhost/45567] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-23 10:06:11,338 INFO [Listener at localhost/45567] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f0c2d64d-3350-bc69-1c38-d6964a44400f/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-23 10:06:11,338 INFO [Listener at localhost/45567] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f0c2d64d-3350-bc69-1c38-d6964a44400f/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-23 10:06:11,338 INFO [Listener at localhost/45567] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f0c2d64d-3350-bc69-1c38-d6964a44400f/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-23 10:06:11,338 INFO [Listener at localhost/45567] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f0c2d64d-3350-bc69-1c38-d6964a44400f/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-23 10:06:11,338 INFO [Listener at localhost/45567] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f0c2d64d-3350-bc69-1c38-d6964a44400f/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-23 10:06:11,338 INFO [Listener at localhost/45567] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f0c2d64d-3350-bc69-1c38-d6964a44400f/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-23 10:06:11,338 INFO [Listener at localhost/45567] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f0c2d64d-3350-bc69-1c38-d6964a44400f/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-23 10:06:11,338 INFO [Listener at localhost/45567] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f0c2d64d-3350-bc69-1c38-d6964a44400f/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-23 10:06:11,338 INFO [Listener at localhost/45567] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f0c2d64d-3350-bc69-1c38-d6964a44400f/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-23 10:06:11,338 INFO [Listener at localhost/45567] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f0c2d64d-3350-bc69-1c38-d6964a44400f/nfs.dump.dir in system properties and HBase conf 2023-07-23 10:06:11,338 INFO [Listener at localhost/45567] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f0c2d64d-3350-bc69-1c38-d6964a44400f/java.io.tmpdir in system properties and HBase conf 2023-07-23 10:06:11,339 INFO [Listener at localhost/45567] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f0c2d64d-3350-bc69-1c38-d6964a44400f/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-23 10:06:11,339 INFO [Listener at localhost/45567] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f0c2d64d-3350-bc69-1c38-d6964a44400f/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-23 10:06:11,339 INFO [Listener at localhost/45567] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f0c2d64d-3350-bc69-1c38-d6964a44400f/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-23 10:06:11,367 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-23 10:06:11,477 INFO [jenkins-hbase4:34097] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-23 10:06:11,478 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=eaf9a3ac32c2b3d5414d70aa7cd9cde4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:11,478 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1690106771241.eaf9a3ac32c2b3d5414d70aa7cd9cde4.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1690106771478"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690106771478"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690106771478"}]},"ts":"1690106771478"} 2023-07-23 10:06:11,483 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure eaf9a3ac32c2b3d5414d70aa7cd9cde4, server=jenkins-hbase4.apache.org,39563,1690106767800}] 2023-07-23 10:06:11,568 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-23 10:06:11,655 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1690106771241.eaf9a3ac32c2b3d5414d70aa7cd9cde4. 2023-07-23 10:06:11,656 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => eaf9a3ac32c2b3d5414d70aa7cd9cde4, NAME => 'hbase:acl,,1690106771241.eaf9a3ac32c2b3d5414d70aa7cd9cde4.', STARTKEY => '', ENDKEY => ''} 2023-07-23 10:06:11,656 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1690106771241.eaf9a3ac32c2b3d5414d70aa7cd9cde4. service=AccessControlService 2023-07-23 10:06:11,656 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 10:06:11,657 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl eaf9a3ac32c2b3d5414d70aa7cd9cde4 2023-07-23 10:06:11,657 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1690106771241.eaf9a3ac32c2b3d5414d70aa7cd9cde4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 10:06:11,657 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for eaf9a3ac32c2b3d5414d70aa7cd9cde4 2023-07-23 10:06:11,657 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for eaf9a3ac32c2b3d5414d70aa7cd9cde4 2023-07-23 10:06:11,663 INFO [StoreOpener-eaf9a3ac32c2b3d5414d70aa7cd9cde4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region eaf9a3ac32c2b3d5414d70aa7cd9cde4 2023-07-23 10:06:11,666 DEBUG [StoreOpener-eaf9a3ac32c2b3d5414d70aa7cd9cde4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/hbase/acl/eaf9a3ac32c2b3d5414d70aa7cd9cde4/l 2023-07-23 10:06:11,666 DEBUG [StoreOpener-eaf9a3ac32c2b3d5414d70aa7cd9cde4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/hbase/acl/eaf9a3ac32c2b3d5414d70aa7cd9cde4/l 2023-07-23 10:06:11,667 INFO [StoreOpener-eaf9a3ac32c2b3d5414d70aa7cd9cde4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region eaf9a3ac32c2b3d5414d70aa7cd9cde4 columnFamilyName l 2023-07-23 10:06:11,668 INFO [StoreOpener-eaf9a3ac32c2b3d5414d70aa7cd9cde4-1] regionserver.HStore(310): Store=eaf9a3ac32c2b3d5414d70aa7cd9cde4/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 10:06:11,671 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/hbase/acl/eaf9a3ac32c2b3d5414d70aa7cd9cde4 2023-07-23 10:06:11,672 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/hbase/acl/eaf9a3ac32c2b3d5414d70aa7cd9cde4 2023-07-23 10:06:11,677 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for eaf9a3ac32c2b3d5414d70aa7cd9cde4 2023-07-23 10:06:11,681 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/hbase/acl/eaf9a3ac32c2b3d5414d70aa7cd9cde4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 10:06:11,682 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened eaf9a3ac32c2b3d5414d70aa7cd9cde4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73000213, jitterRate=0.0877879410982132}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 10:06:11,682 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for eaf9a3ac32c2b3d5414d70aa7cd9cde4: 2023-07-23 10:06:11,684 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1690106771241.eaf9a3ac32c2b3d5414d70aa7cd9cde4., pid=11, masterSystemTime=1690106771639 2023-07-23 10:06:11,687 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1690106771241.eaf9a3ac32c2b3d5414d70aa7cd9cde4. 2023-07-23 10:06:11,687 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1690106771241.eaf9a3ac32c2b3d5414d70aa7cd9cde4. 2023-07-23 10:06:11,688 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=eaf9a3ac32c2b3d5414d70aa7cd9cde4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:11,688 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1690106771241.eaf9a3ac32c2b3d5414d70aa7cd9cde4.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1690106771688"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690106771688"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690106771688"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690106771688"}]},"ts":"1690106771688"} 2023-07-23 10:06:11,697 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-23 10:06:11,697 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure eaf9a3ac32c2b3d5414d70aa7cd9cde4, server=jenkins-hbase4.apache.org,39563,1690106767800 in 208 msec 2023-07-23 10:06:11,702 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-23 10:06:11,702 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=eaf9a3ac32c2b3d5414d70aa7cd9cde4, ASSIGN in 375 msec 2023-07-23 10:06:11,703 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-23 10:06:11,703 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690106771703"}]},"ts":"1690106771703"} 2023-07-23 10:06:11,706 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-23 10:06:11,709 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-23 10:06:11,715 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 463 msec 2023-07-23 10:06:11,868 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-23 10:06:11,869 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-23 10:06:11,903 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-23 10:06:12,678 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-23 10:06:13,000 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-07-23 10:06:13,008 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f0c2d64d-3350-bc69-1c38-d6964a44400f/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_37571_jobhistory____toky50/webapp 2023-07-23 10:06:13,172 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-23 10:06:13,172 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-23 10:06:13,172 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-23 10:06:13,175 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-23 10:06:13,244 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-23 10:06:13,531 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-23 10:06:13,806 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-23 10:06:13,840 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:37571 2023-07-23 10:06:14,175 WARN [Listener at jenkins-hbase4.apache.org/42903] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-23 10:06:14,640 WARN [Listener at jenkins-hbase4.apache.org/42903] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-23 10:06:14,641 INFO [Listener at jenkins-hbase4.apache.org/42903] log.Slf4jLog(67): jetty-6.1.26 2023-07-23 10:06:14,661 INFO [Listener at jenkins-hbase4.apache.org/42903] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f0c2d64d-3350-bc69-1c38-d6964a44400f/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_46553_cluster____.e991ot/webapp 2023-07-23 10:06:14,770 INFO [Listener at jenkins-hbase4.apache.org/42903] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-23 10:06:14,770 INFO [Listener at jenkins-hbase4.apache.org/42903] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-23 10:06:14,770 INFO [Listener at jenkins-hbase4.apache.org/42903] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-23 10:06:14,772 INFO [Listener at jenkins-hbase4.apache.org/42903] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-23 10:06:14,787 INFO [Listener at jenkins-hbase4.apache.org/42903] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-23 10:06:15,000 INFO [Listener at jenkins-hbase4.apache.org/42903] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-23 10:06:15,123 INFO [Listener at jenkins-hbase4.apache.org/42903] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-23 10:06:15,131 INFO [Listener at jenkins-hbase4.apache.org/42903] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:46553 2023-07-23 10:06:15,570 WARN [Listener at jenkins-hbase4.apache.org/32809] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-23 10:06:15,593 WARN [Listener at jenkins-hbase4.apache.org/32809] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-23 10:06:15,594 INFO [Listener at jenkins-hbase4.apache.org/32809] log.Slf4jLog(67): jetty-6.1.26 2023-07-23 10:06:15,600 INFO [Listener at jenkins-hbase4.apache.org/32809] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f0c2d64d-3350-bc69-1c38-d6964a44400f/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_36439_node____m0ee1h/webapp 2023-07-23 10:06:15,652 INFO [Listener at jenkins-hbase4.apache.org/32809] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-23 10:06:15,652 INFO [Listener at jenkins-hbase4.apache.org/32809] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-23 10:06:15,652 INFO [Listener at jenkins-hbase4.apache.org/32809] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-23 10:06:15,652 INFO [Listener at jenkins-hbase4.apache.org/32809] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-23 10:06:15,660 INFO [Listener at jenkins-hbase4.apache.org/32809] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-23 10:06:15,677 INFO [Listener at jenkins-hbase4.apache.org/32809] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-23 10:06:15,774 INFO [Listener at jenkins-hbase4.apache.org/32809] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-23 10:06:15,796 INFO [Listener at jenkins-hbase4.apache.org/32809] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:36439 2023-07-23 10:06:15,916 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-23 10:06:16,093 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-23 10:06:16,094 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-23 10:06:16,095 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-23 10:06:16,222 WARN [Listener at jenkins-hbase4.apache.org/44565] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-23 10:06:16,231 WARN [Listener at jenkins-hbase4.apache.org/44565] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-23 10:06:16,232 INFO [Listener at jenkins-hbase4.apache.org/44565] log.Slf4jLog(67): jetty-6.1.26 2023-07-23 10:06:16,237 INFO [Listener at jenkins-hbase4.apache.org/44565] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f0c2d64d-3350-bc69-1c38-d6964a44400f/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_39913_node____.5cs1ql/webapp 2023-07-23 10:06:16,332 INFO [Listener at jenkins-hbase4.apache.org/44565] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-23 10:06:16,333 INFO [Listener at jenkins-hbase4.apache.org/44565] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-23 10:06:16,333 INFO [Listener at jenkins-hbase4.apache.org/44565] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-23 10:06:16,333 INFO [Listener at jenkins-hbase4.apache.org/44565] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-23 10:06:16,341 INFO [Listener at jenkins-hbase4.apache.org/44565] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-23 10:06:16,362 INFO [Listener at jenkins-hbase4.apache.org/44565] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-23 10:06:16,409 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 10:06:16,410 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-23 10:06:16,410 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 10:06:16,410 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-23 10:06:16,411 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-23 10:06:16,411 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-23 10:06:16,411 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 10:06:16,411 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-23 10:06:16,411 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-23 10:06:16,411 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-23 10:06:16,449 INFO [Listener at jenkins-hbase4.apache.org/44565] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-23 10:06:16,472 INFO [Listener at jenkins-hbase4.apache.org/44565] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:39913 2023-07-23 10:06:16,511 INFO [Listener at jenkins-hbase4.apache.org/44565] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-23 10:06:16,513 INFO [Listener at jenkins-hbase4.apache.org/44565] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 10:06:16,579 INFO [Listener at jenkins-hbase4.apache.org/44565] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=705, OpenFileDescriptor=900, MaxFileDescriptor=60000, SystemLoadAverage=153, ProcessCount=173, AvailableMemoryMB=8334 2023-07-23 10:06:16,579 WARN [Listener at jenkins-hbase4.apache.org/44565] hbase.ResourceChecker(130): Thread=705 is superior to 500 2023-07-23 10:06:16,598 DEBUG [Listener at jenkins-hbase4.apache.org/44565] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-23 10:06:16,604 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47898, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-23 10:06:16,611 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-23 10:06:16,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-23 10:06:16,618 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-23 10:06:16,619 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-23 10:06:16,623 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-23 10:06:16,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-23 10:06:16,630 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportWithTargetName/62f82f226b28e5cca13eb65698d0e014 2023-07-23 10:06:16,636 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportWithTargetName/62f82f226b28e5cca13eb65698d0e014 empty. 2023-07-23 10:06:16,636 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportWithTargetName/dd910dc1df5fc62c86a9daf9bd4a27c9 2023-07-23 10:06:16,638 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportWithTargetName/dd910dc1df5fc62c86a9daf9bd4a27c9 empty. 2023-07-23 10:06:16,638 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportWithTargetName/62f82f226b28e5cca13eb65698d0e014 2023-07-23 10:06:16,639 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportWithTargetName/dd910dc1df5fc62c86a9daf9bd4a27c9 2023-07-23 10:06:16,639 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-23 10:06:16,678 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-23 10:06:16,680 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => dd910dc1df5fc62c86a9daf9bd4a27c9, NAME => 'testtb-testExportWithTargetName,1,1690106776611.dd910dc1df5fc62c86a9daf9bd4a27c9.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp 2023-07-23 10:06:16,680 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 62f82f226b28e5cca13eb65698d0e014, NAME => 'testtb-testExportWithTargetName,,1690106776611.62f82f226b28e5cca13eb65698d0e014.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp 2023-07-23 10:06:16,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-23 10:06:16,732 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1690106776611.62f82f226b28e5cca13eb65698d0e014.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 10:06:16,733 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 62f82f226b28e5cca13eb65698d0e014, disabling compactions & flushes 2023-07-23 10:06:16,733 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1690106776611.62f82f226b28e5cca13eb65698d0e014. 2023-07-23 10:06:16,733 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1690106776611.62f82f226b28e5cca13eb65698d0e014. 2023-07-23 10:06:16,733 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1690106776611.62f82f226b28e5cca13eb65698d0e014. after waiting 0 ms 2023-07-23 10:06:16,733 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1690106776611.62f82f226b28e5cca13eb65698d0e014. 2023-07-23 10:06:16,733 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1690106776611.62f82f226b28e5cca13eb65698d0e014. 2023-07-23 10:06:16,733 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 62f82f226b28e5cca13eb65698d0e014: 2023-07-23 10:06:16,738 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1690106776611.dd910dc1df5fc62c86a9daf9bd4a27c9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 10:06:16,738 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing dd910dc1df5fc62c86a9daf9bd4a27c9, disabling compactions & flushes 2023-07-23 10:06:16,738 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1690106776611.dd910dc1df5fc62c86a9daf9bd4a27c9. 2023-07-23 10:06:16,738 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1690106776611.dd910dc1df5fc62c86a9daf9bd4a27c9. 2023-07-23 10:06:16,738 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1690106776611.dd910dc1df5fc62c86a9daf9bd4a27c9. after waiting 0 ms 2023-07-23 10:06:16,738 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1690106776611.dd910dc1df5fc62c86a9daf9bd4a27c9. 2023-07-23 10:06:16,738 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1690106776611.dd910dc1df5fc62c86a9daf9bd4a27c9. 2023-07-23 10:06:16,739 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for dd910dc1df5fc62c86a9daf9bd4a27c9: 2023-07-23 10:06:16,743 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-23 10:06:16,744 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1690106776611.62f82f226b28e5cca13eb65698d0e014.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690106776744"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690106776744"}]},"ts":"1690106776744"} 2023-07-23 10:06:16,744 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1690106776611.dd910dc1df5fc62c86a9daf9bd4a27c9.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690106776744"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690106776744"}]},"ts":"1690106776744"} 2023-07-23 10:06:16,801 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-23 10:06:16,804 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-23 10:06:16,805 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690106776804"}]},"ts":"1690106776804"} 2023-07-23 10:06:16,808 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-23 10:06:16,813 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-23 10:06:16,816 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-23 10:06:16,816 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-23 10:06:16,816 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-23 10:06:16,816 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-23 10:06:16,817 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=62f82f226b28e5cca13eb65698d0e014, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=dd910dc1df5fc62c86a9daf9bd4a27c9, ASSIGN}] 2023-07-23 10:06:16,821 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=dd910dc1df5fc62c86a9daf9bd4a27c9, ASSIGN 2023-07-23 10:06:16,824 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=62f82f226b28e5cca13eb65698d0e014, ASSIGN 2023-07-23 10:06:16,825 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=dd910dc1df5fc62c86a9daf9bd4a27c9, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36827,1690106767853; forceNewPlan=false, retain=false 2023-07-23 10:06:16,826 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=62f82f226b28e5cca13eb65698d0e014, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36599,1690106767729; forceNewPlan=false, retain=false 2023-07-23 10:06:16,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-23 10:06:16,975 INFO [jenkins-hbase4:34097] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-23 10:06:16,978 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=62f82f226b28e5cca13eb65698d0e014, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:16,978 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=dd910dc1df5fc62c86a9daf9bd4a27c9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:16,979 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1690106776611.62f82f226b28e5cca13eb65698d0e014.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690106776978"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690106776978"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690106776978"}]},"ts":"1690106776978"} 2023-07-23 10:06:16,979 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1690106776611.dd910dc1df5fc62c86a9daf9bd4a27c9.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690106776978"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690106776978"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690106776978"}]},"ts":"1690106776978"} 2023-07-23 10:06:16,983 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=13, state=RUNNABLE; OpenRegionProcedure 62f82f226b28e5cca13eb65698d0e014, server=jenkins-hbase4.apache.org,36599,1690106767729}] 2023-07-23 10:06:16,985 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=14, state=RUNNABLE; OpenRegionProcedure dd910dc1df5fc62c86a9daf9bd4a27c9, server=jenkins-hbase4.apache.org,36827,1690106767853}] 2023-07-23 10:06:17,138 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:17,139 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-23 10:06:17,143 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50184, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-23 10:06:17,158 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1690106776611.dd910dc1df5fc62c86a9daf9bd4a27c9. 2023-07-23 10:06:17,158 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1690106776611.62f82f226b28e5cca13eb65698d0e014. 2023-07-23 10:06:17,158 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 62f82f226b28e5cca13eb65698d0e014, NAME => 'testtb-testExportWithTargetName,,1690106776611.62f82f226b28e5cca13eb65698d0e014.', STARTKEY => '', ENDKEY => '1'} 2023-07-23 10:06:17,158 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => dd910dc1df5fc62c86a9daf9bd4a27c9, NAME => 'testtb-testExportWithTargetName,1,1690106776611.dd910dc1df5fc62c86a9daf9bd4a27c9.', STARTKEY => '1', ENDKEY => ''} 2023-07-23 10:06:17,158 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1690106776611.62f82f226b28e5cca13eb65698d0e014. service=AccessControlService 2023-07-23 10:06:17,158 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1690106776611.dd910dc1df5fc62c86a9daf9bd4a27c9. service=AccessControlService 2023-07-23 10:06:17,159 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 10:06:17,159 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 10:06:17,159 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 62f82f226b28e5cca13eb65698d0e014 2023-07-23 10:06:17,159 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName dd910dc1df5fc62c86a9daf9bd4a27c9 2023-07-23 10:06:17,159 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1690106776611.62f82f226b28e5cca13eb65698d0e014.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 10:06:17,159 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1690106776611.dd910dc1df5fc62c86a9daf9bd4a27c9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 10:06:17,159 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 62f82f226b28e5cca13eb65698d0e014 2023-07-23 10:06:17,159 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for dd910dc1df5fc62c86a9daf9bd4a27c9 2023-07-23 10:06:17,159 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 62f82f226b28e5cca13eb65698d0e014 2023-07-23 10:06:17,160 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for dd910dc1df5fc62c86a9daf9bd4a27c9 2023-07-23 10:06:17,174 INFO [StoreOpener-62f82f226b28e5cca13eb65698d0e014-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 62f82f226b28e5cca13eb65698d0e014 2023-07-23 10:06:17,174 INFO [StoreOpener-dd910dc1df5fc62c86a9daf9bd4a27c9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region dd910dc1df5fc62c86a9daf9bd4a27c9 2023-07-23 10:06:17,176 DEBUG [StoreOpener-62f82f226b28e5cca13eb65698d0e014-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportWithTargetName/62f82f226b28e5cca13eb65698d0e014/cf 2023-07-23 10:06:17,176 DEBUG [StoreOpener-62f82f226b28e5cca13eb65698d0e014-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportWithTargetName/62f82f226b28e5cca13eb65698d0e014/cf 2023-07-23 10:06:17,177 DEBUG [StoreOpener-dd910dc1df5fc62c86a9daf9bd4a27c9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportWithTargetName/dd910dc1df5fc62c86a9daf9bd4a27c9/cf 2023-07-23 10:06:17,177 DEBUG [StoreOpener-dd910dc1df5fc62c86a9daf9bd4a27c9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportWithTargetName/dd910dc1df5fc62c86a9daf9bd4a27c9/cf 2023-07-23 10:06:17,181 INFO [StoreOpener-dd910dc1df5fc62c86a9daf9bd4a27c9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dd910dc1df5fc62c86a9daf9bd4a27c9 columnFamilyName cf 2023-07-23 10:06:17,181 INFO [StoreOpener-62f82f226b28e5cca13eb65698d0e014-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 62f82f226b28e5cca13eb65698d0e014 columnFamilyName cf 2023-07-23 10:06:17,184 INFO [StoreOpener-62f82f226b28e5cca13eb65698d0e014-1] regionserver.HStore(310): Store=62f82f226b28e5cca13eb65698d0e014/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 10:06:17,184 INFO [StoreOpener-dd910dc1df5fc62c86a9daf9bd4a27c9-1] regionserver.HStore(310): Store=dd910dc1df5fc62c86a9daf9bd4a27c9/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 10:06:17,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportWithTargetName/dd910dc1df5fc62c86a9daf9bd4a27c9 2023-07-23 10:06:17,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportWithTargetName/dd910dc1df5fc62c86a9daf9bd4a27c9 2023-07-23 10:06:17,190 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportWithTargetName/62f82f226b28e5cca13eb65698d0e014 2023-07-23 10:06:17,191 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportWithTargetName/62f82f226b28e5cca13eb65698d0e014 2023-07-23 10:06:17,196 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 62f82f226b28e5cca13eb65698d0e014 2023-07-23 10:06:17,198 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for dd910dc1df5fc62c86a9daf9bd4a27c9 2023-07-23 10:06:17,205 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportWithTargetName/62f82f226b28e5cca13eb65698d0e014/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 10:06:17,206 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 62f82f226b28e5cca13eb65698d0e014; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58940952, jitterRate=-0.1217113733291626}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 10:06:17,206 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 62f82f226b28e5cca13eb65698d0e014: 2023-07-23 10:06:17,212 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportWithTargetName/dd910dc1df5fc62c86a9daf9bd4a27c9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 10:06:17,212 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1690106776611.62f82f226b28e5cca13eb65698d0e014., pid=15, masterSystemTime=1690106777138 2023-07-23 10:06:17,219 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened dd910dc1df5fc62c86a9daf9bd4a27c9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64073790, jitterRate=-0.04522612690925598}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 10:06:17,219 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for dd910dc1df5fc62c86a9daf9bd4a27c9: 2023-07-23 10:06:17,220 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1690106776611.dd910dc1df5fc62c86a9daf9bd4a27c9., pid=16, masterSystemTime=1690106777140 2023-07-23 10:06:17,222 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1690106776611.62f82f226b28e5cca13eb65698d0e014. 2023-07-23 10:06:17,223 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=62f82f226b28e5cca13eb65698d0e014, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:17,224 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1690106776611.62f82f226b28e5cca13eb65698d0e014.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690106777223"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690106777223"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690106777223"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690106777223"}]},"ts":"1690106777223"} 2023-07-23 10:06:17,226 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1690106776611.dd910dc1df5fc62c86a9daf9bd4a27c9. 2023-07-23 10:06:17,226 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1690106776611.dd910dc1df5fc62c86a9daf9bd4a27c9. 2023-07-23 10:06:17,228 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1690106776611.62f82f226b28e5cca13eb65698d0e014. 2023-07-23 10:06:17,230 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=dd910dc1df5fc62c86a9daf9bd4a27c9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:17,231 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1690106776611.dd910dc1df5fc62c86a9daf9bd4a27c9.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690106777226"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690106777226"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690106777226"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690106777226"}]},"ts":"1690106777226"} 2023-07-23 10:06:17,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-23 10:06:17,237 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=13 2023-07-23 10:06:17,238 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=13, state=SUCCESS; OpenRegionProcedure 62f82f226b28e5cca13eb65698d0e014, server=jenkins-hbase4.apache.org,36599,1690106767729 in 249 msec 2023-07-23 10:06:17,240 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=14 2023-07-23 10:06:17,240 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=14, state=SUCCESS; OpenRegionProcedure dd910dc1df5fc62c86a9daf9bd4a27c9, server=jenkins-hbase4.apache.org,36827,1690106767853 in 250 msec 2023-07-23 10:06:17,240 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=62f82f226b28e5cca13eb65698d0e014, ASSIGN in 420 msec 2023-07-23 10:06:17,243 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=12 2023-07-23 10:06:17,243 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=dd910dc1df5fc62c86a9daf9bd4a27c9, ASSIGN in 423 msec 2023-07-23 10:06:17,244 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-23 10:06:17,244 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690106777244"}]},"ts":"1690106777244"} 2023-07-23 10:06:17,246 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-23 10:06:17,250 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-23 10:06:17,257 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-23 10:06:17,277 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39563] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-23 10:06:17,307 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-23 10:06:17,307 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-23 10:06:17,307 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-23 10:06:17,307 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-23 10:06:17,307 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-23 10:06:17,319 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-23 10:06:17,319 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-23 10:06:17,319 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-23 10:06:17,319 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-23 10:06:17,320 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-23 10:06:17,320 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-23 10:06:17,323 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 708 msec 2023-07-23 10:06:17,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-23 10:06:17,737 INFO [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-23 10:06:17,741 DEBUG [Listener at jenkins-hbase4.apache.org/44565] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-23 10:06:17,743 DEBUG [Listener at jenkins-hbase4.apache.org/44565] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1690106776611.62f82f226b28e5cca13eb65698d0e014. 2023-07-23 10:06:17,745 INFO [Listener at jenkins-hbase4.apache.org/44565] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 10:06:17,775 DEBUG [hconnection-0x4f1da2dd-shared-pool-4] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 10:06:17,781 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50194, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 10:06:17,785 DEBUG [hconnection-0x4f1da2dd-shared-pool-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 10:06:17,792 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59388, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 10:06:17,807 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-23 10:06:17,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690106777808 (current time:1690106777808). 2023-07-23 10:06:17,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-23 10:06:17,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] zookeeper.ReadOnlyZKClient(139): Connect 0x48195743 to 127.0.0.1:55181 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 10:06:17,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@740a8acf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 10:06:17,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 10:06:17,818 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60988, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 10:06:17,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x48195743 to 127.0.0.1:55181 2023-07-23 10:06:17,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 10:06:17,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] zookeeper.ReadOnlyZKClient(139): Connect 0x3da6018c to 127.0.0.1:55181 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 10:06:17,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@42b6a6fe, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 10:06:17,828 DEBUG [hconnection-0x78ad4e37-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 10:06:17,830 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32768, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 10:06:17,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3da6018c to 127.0.0.1:55181 2023-07-23 10:06:17,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 10:06:17,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-23 10:06:17,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-23 10:06:17,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-23 10:06:17,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-23 10:06:17,888 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-23 10:06:17,890 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1690107377890 2023-07-23 10:06:17,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-23 10:06:17,890 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-23 10:06:17,893 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-23 10:06:17,897 DEBUG [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-23 10:06:17,898 DEBUG [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-23 10:06:17,898 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-23 10:06:17,899 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 16 msec 2023-07-23 10:06:17,900 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-23 10:06:17,901 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1690107377901 2023-07-23 10:06:17,938 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:17,939 INFO [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-23 10:06:17,939 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:06:17,940 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-23 10:06:17,940 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-23 10:06:17,940 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:17,941 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:17,945 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:06:17,945 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:17,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:06:17,945 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:06:17,945 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:06:17,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:06:17,946 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:06:17,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:06:17,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:06:17,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:06:17,946 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:17,946 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:17,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:17,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:17,947 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:17,947 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-23 10:06:17,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:17,947 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:17,947 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:17,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-23 10:06:17,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:17,948 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:17,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-23 10:06:17,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:17,948 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-23 10:06:17,949 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-23 10:06:17,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-23 10:06:17,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:17,951 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-23 10:06:17,953 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:17,954 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:17,954 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:17,959 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-23 10:06:17,959 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:06:17,959 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-23 10:06:17,959 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:06:17,959 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-23 10:06:17,959 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:06:17,960 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-23 10:06:17,961 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-23 10:06:17,962 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36827,1690106767853' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-23 10:06:17,960 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-23 10:06:17,962 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-23 10:06:17,962 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36599,1690106767729' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-23 10:06:17,961 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-23 10:06:17,962 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-23 10:06:17,962 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39563,1690106767800' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-23 10:06:17,964 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:17,964 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:17,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:17,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:06:17,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:06:17,968 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:17,968 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:17,968 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:17,968 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:17,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:06:17,968 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 10:06:17,968 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:17,969 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 10:06:17,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:06:17,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:17,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:17,970 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:17,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:17,970 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 10:06:17,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:17,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:06:17,971 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36827,1690106767853' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-23 10:06:17,971 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@143677e7[Count = 1] remaining members to acquire global barrier 2023-07-23 10:06:17,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:17,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:06:17,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:06:17,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:06:17,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:06:17,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:17,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:17,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:17,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:17,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:06:17,974 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36599,1690106767729' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-23 10:06:17,974 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@143677e7[Count = 0] remaining members to acquire global barrier 2023-07-23 10:06:17,974 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-23 10:06:17,974 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:17,976 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:17,976 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:17,977 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:17,977 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:17,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:17,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:17,977 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-23 10:06:17,977 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-23 10:06:17,977 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:17,977 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:17,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:17,978 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:17,978 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-23 10:06:17,978 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-23 10:06:17,978 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,39563,1690106767800' in zk 2023-07-23 10:06:17,979 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:17,979 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-23 10:06:17,987 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 10:06:17,987 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 10:06:17,991 DEBUG [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1690106776611.62f82f226b28e5cca13eb65698d0e014. 2023-07-23 10:06:17,991 DEBUG [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1690106776611.62f82f226b28e5cca13eb65698d0e014. started... 2023-07-23 10:06:17,994 DEBUG [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 62f82f226b28e5cca13eb65698d0e014: 2023-07-23 10:06:17,998 DEBUG [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 10:06:17,999 DEBUG [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1690106776611.62f82f226b28e5cca13eb65698d0e014.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:18,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-23 10:06:18,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-23 10:06:18,006 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 10:06:18,006 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 10:06:18,006 DEBUG [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1690106776611.dd910dc1df5fc62c86a9daf9bd4a27c9. 2023-07-23 10:06:18,006 DEBUG [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-23 10:06:18,006 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-23 10:06:18,007 DEBUG [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1690106776611.dd910dc1df5fc62c86a9daf9bd4a27c9. started... 2023-07-23 10:06:18,007 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:06:18,007 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-23 10:06:18,008 DEBUG [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for dd910dc1df5fc62c86a9daf9bd4a27c9: 2023-07-23 10:06:18,009 DEBUG [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1690106776611.dd910dc1df5fc62c86a9daf9bd4a27c9.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:18,012 DEBUG [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 10:06:18,012 DEBUG [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 10:06:18,017 DEBUG [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-23 10:06:18,017 DEBUG [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-23 10:06:18,061 DEBUG [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1690106776611.dd910dc1df5fc62c86a9daf9bd4a27c9. completed. 2023-07-23 10:06:18,061 DEBUG [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1690106776611.dd910dc1df5fc62c86a9daf9bd4a27c9. 2023-07-23 10:06:18,062 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 10:06:18,062 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 10:06:18,062 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:18,062 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-23 10:06:18,062 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,36827,1690106767853' in zk 2023-07-23 10:06:18,063 DEBUG [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1690106776611.62f82f226b28e5cca13eb65698d0e014. completed. 2023-07-23 10:06:18,063 DEBUG [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1690106776611.62f82f226b28e5cca13eb65698d0e014. 2023-07-23 10:06:18,063 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 10:06:18,063 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 10:06:18,063 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:18,063 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-23 10:06:18,063 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,36599,1690106767729' in zk 2023-07-23 10:06:18,065 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:18,065 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-23 10:06:18,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:18,065 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:06:18,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:06:18,065 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-23 10:06:18,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:06:18,067 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:18,067 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-23 10:06:18,067 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:06:18,067 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-23 10:06:18,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:06:18,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:06:18,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:18,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:18,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:18,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:18,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:06:18,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:18,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:18,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:18,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:18,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,36599,1690106767729': 2023-07-23 10:06:18,074 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36599,1690106767729' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-23 10:06:18,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:18,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:06:18,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:06:18,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:06:18,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:06:18,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:18,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:18,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:18,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:18,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:06:18,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:18,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:18,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:18,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:18,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,36827,1690106767853': 2023-07-23 10:06:18,080 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36827,1690106767853' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-23 10:06:18,080 INFO [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-23 10:06:18,080 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-23 10:06:18,080 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-23 10:06:18,080 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:18,080 INFO [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-23 10:06:18,085 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:18,085 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:18,085 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:06:18,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:18,085 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:18,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:18,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:18,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:06:18,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:06:18,085 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:06:18,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:18,085 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:18,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:18,086 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:18,086 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:06:18,086 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:06:18,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:18,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:06:18,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:06:18,086 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:18,087 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:06:18,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:06:18,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:18,087 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:06:18,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:06:18,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:18,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:18,087 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:18,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:18,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:06:18,088 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:18,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:18,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:18,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:18,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:18,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:06:18,091 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:18,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:18,091 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:18,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:18,092 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:18,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:18,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:18,107 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:06:18,107 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:06:18,107 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:06:18,107 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:06:18,107 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:18,107 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:06:18,107 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:18,107 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:06:18,107 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:18,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:06:18,107 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:06:18,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:06:18,107 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:06:18,107 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:18,108 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:18,108 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:18,108 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:18,108 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:18,108 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:18,108 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:18,108 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:18,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:06:18,108 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:06:18,108 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:06:18,108 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:06:18,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:06:18,109 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:06:18,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:06:18,108 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:18,109 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:06:18,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:06:18,109 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-23 10:06:18,110 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:18,110 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-23 10:06:18,111 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-23 10:06:18,143 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:18,145 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:18,207 DEBUG [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 10:06:18,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-23 10:06:18,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-23 10:06:18,209 DEBUG [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-23 10:06:18,215 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:18,259 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-23 10:06:18,259 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:18,260 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:18,261 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1690106777890Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1690106778142 (+252 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1690106778143 (+1 ms)Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1690106778143Writing data manifest for emptySnaptb0-testExportWithTargetName at 1690106778158 (+15 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1690106778200 (+42 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1690106778259 (+59 ms) 2023-07-23 10:06:18,262 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-23 10:06:18,265 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 370 msec 2023-07-23 10:06:18,509 DEBUG [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 10:06:18,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-23 10:06:18,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-23 10:06:18,531 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36599] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1690106776611.62f82f226b28e5cca13eb65698d0e014. with WAL disabled. Data may be lost in the event of a crash. 2023-07-23 10:06:18,534 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36827] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1690106776611.dd910dc1df5fc62c86a9daf9bd4a27c9. with WAL disabled. Data may be lost in the event of a crash. 2023-07-23 10:06:18,541 DEBUG [Listener at jenkins-hbase4.apache.org/44565] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-23 10:06:18,542 DEBUG [Listener at jenkins-hbase4.apache.org/44565] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1690106776611.62f82f226b28e5cca13eb65698d0e014. 2023-07-23 10:06:18,542 INFO [Listener at jenkins-hbase4.apache.org/44565] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 10:06:18,560 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-23 10:06:18,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690106778560 (current time:1690106778560). 2023-07-23 10:06:18,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-23 10:06:18,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] zookeeper.ReadOnlyZKClient(139): Connect 0x59aee913 to 127.0.0.1:55181 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 10:06:18,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@49d09309, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 10:06:18,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 10:06:18,569 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32776, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 10:06:18,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x59aee913 to 127.0.0.1:55181 2023-07-23 10:06:18,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 10:06:18,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] zookeeper.ReadOnlyZKClient(139): Connect 0x211f6c1c to 127.0.0.1:55181 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 10:06:18,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@fd7ff5d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 10:06:18,577 DEBUG [hconnection-0x42526d75-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 10:06:18,579 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32788, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 10:06:18,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x211f6c1c to 127.0.0.1:55181 2023-07-23 10:06:18,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 10:06:18,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-23 10:06:18,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-23 10:06:18,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-23 10:06:18,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-23 10:06:18,588 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-23 10:06:18,589 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1690107378589 2023-07-23 10:06:18,589 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-23 10:06:18,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-23 10:06:18,590 DEBUG [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-23 10:06:18,591 DEBUG [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-23 10:06:18,591 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-23 10:06:18,592 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-23 10:06:18,593 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 6 msec 2023-07-23 10:06:18,594 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-23 10:06:18,595 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1690107378595 2023-07-23 10:06:18,612 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-23 10:06:18,612 INFO [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-23 10:06:18,612 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:06:18,613 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-23 10:06:18,613 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-23 10:06:18,613 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 10:06:18,613 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-23 10:06:18,614 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:06:18,614 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:06:18,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:06:18,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:06:18,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:06:18,614 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:18,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:06:18,615 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:06:18,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:06:18,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:06:18,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-23 10:06:18,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-23 10:06:18,615 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:18,615 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:18,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-23 10:06:18,616 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 10:06:18,616 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:18,616 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 10:06:18,616 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-23 10:06:18,616 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 10:06:18,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-23 10:06:18,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-23 10:06:18,616 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-23 10:06:18,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-23 10:06:18,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-23 10:06:18,617 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-23 10:06:18,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-23 10:06:18,617 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-23 10:06:18,617 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-23 10:06:18,617 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:06:18,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-23 10:06:18,618 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-23 10:06:18,618 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-23 10:06:18,618 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-23 10:06:18,618 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-23 10:06:18,618 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:06:18,618 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-23 10:06:18,618 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-23 10:06:18,619 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-23 10:06:18,618 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36827,1690106767853' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-23 10:06:18,619 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36599,1690106767729' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-23 10:06:18,619 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-23 10:06:18,619 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-23 10:06:18,619 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:06:18,620 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-23 10:06:18,620 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-23 10:06:18,620 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39563,1690106767800' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-23 10:06:18,622 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:18,622 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 10:06:18,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:18,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:06:18,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:06:18,622 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:18,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:06:18,622 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 10:06:18,623 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 10:06:18,623 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 10:06:18,627 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 10:06:18,627 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 10:06:18,627 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 10:06:18,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:06:18,627 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 10:06:18,627 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 10:06:18,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-23 10:06:18,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:18,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:18,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:18,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:06:18,629 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36827,1690106767853' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-23 10:06:18,629 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@257204dd[Count = 1] remaining members to acquire global barrier 2023-07-23 10:06:18,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:18,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:06:18,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:06:18,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:06:18,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:06:18,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-23 10:06:18,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:18,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:18,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:18,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:06:18,631 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36599,1690106767729' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-23 10:06:18,631 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@257204dd[Count = 0] remaining members to acquire global barrier 2023-07-23 10:06:18,631 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-23 10:06:18,631 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 10:06:18,635 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 10:06:18,635 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 10:06:18,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 10:06:18,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 10:06:18,635 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 10:06:18,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 10:06:18,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 10:06:18,635 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-23 10:06:18,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 10:06:18,635 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-23 10:06:18,635 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-23 10:06:18,635 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,39563,1690106767800' in zk 2023-07-23 10:06:18,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 10:06:18,635 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:18,635 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 10:06:18,636 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 10:06:18,635 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-23 10:06:18,636 DEBUG [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1690106776611.dd910dc1df5fc62c86a9daf9bd4a27c9. 2023-07-23 10:06:18,636 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 10:06:18,636 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:18,636 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 10:06:18,636 DEBUG [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1690106776611.62f82f226b28e5cca13eb65698d0e014. 2023-07-23 10:06:18,636 DEBUG [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1690106776611.dd910dc1df5fc62c86a9daf9bd4a27c9. started... 2023-07-23 10:06:18,636 DEBUG [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1690106776611.62f82f226b28e5cca13eb65698d0e014. started... 2023-07-23 10:06:18,636 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-23 10:06:18,636 INFO [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 62f82f226b28e5cca13eb65698d0e014 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-23 10:06:18,636 INFO [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] regionserver.HRegion(2745): Flushing dd910dc1df5fc62c86a9daf9bd4a27c9 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-23 10:06:18,638 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-23 10:06:18,638 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:06:18,638 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-23 10:06:18,691 DEBUG [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 10:06:18,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-23 10:06:18,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-23 10:06:18,693 DEBUG [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-23 10:06:18,800 INFO [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230723f4964170e0b547d788ff2de9c2a20d5c to hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230723f4964170e0b547d788ff2de9c2a20d5c 2023-07-23 10:06:18,800 INFO [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023072392aacb9518fd4d7bb75828f18ae12e4e to hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023072392aacb9518fd4d7bb75828f18ae12e4e 2023-07-23 10:06:18,847 INFO [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportWithTargetName/dd910dc1df5fc62c86a9daf9bd4a27c9/.tmp/cf/4c37406da9184e30af2000a1a04acd25 2023-07-23 10:06:18,848 INFO [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportWithTargetName/62f82f226b28e5cca13eb65698d0e014/.tmp/cf/34ad58c1aa2e4389a88f86826828bae4 2023-07-23 10:06:18,859 DEBUG [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportWithTargetName/dd910dc1df5fc62c86a9daf9bd4a27c9/.tmp/cf/4c37406da9184e30af2000a1a04acd25 as hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportWithTargetName/dd910dc1df5fc62c86a9daf9bd4a27c9/cf/4c37406da9184e30af2000a1a04acd25 2023-07-23 10:06:18,859 DEBUG [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportWithTargetName/62f82f226b28e5cca13eb65698d0e014/.tmp/cf/34ad58c1aa2e4389a88f86826828bae4 as hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportWithTargetName/62f82f226b28e5cca13eb65698d0e014/cf/34ad58c1aa2e4389a88f86826828bae4 2023-07-23 10:06:18,873 INFO [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportWithTargetName/dd910dc1df5fc62c86a9daf9bd4a27c9/cf/4c37406da9184e30af2000a1a04acd25, entries=48, sequenceid=6, filesize=13.0 K 2023-07-23 10:06:18,875 INFO [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportWithTargetName/62f82f226b28e5cca13eb65698d0e014/cf/34ad58c1aa2e4389a88f86826828bae4, entries=2, sequenceid=6, filesize=5.2 K 2023-07-23 10:06:18,880 INFO [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 62f82f226b28e5cca13eb65698d0e014 in 244ms, sequenceid=6, compaction requested=false 2023-07-23 10:06:18,880 DEBUG [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-23 10:06:18,882 DEBUG [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 62f82f226b28e5cca13eb65698d0e014: 2023-07-23 10:06:18,882 DEBUG [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1690106776611.62f82f226b28e5cca13eb65698d0e014.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-23 10:06:18,882 DEBUG [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 10:06:18,882 DEBUG [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportWithTargetName/62f82f226b28e5cca13eb65698d0e014/cf/34ad58c1aa2e4389a88f86826828bae4] hfiles 2023-07-23 10:06:18,883 DEBUG [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportWithTargetName/62f82f226b28e5cca13eb65698d0e014/cf/34ad58c1aa2e4389a88f86826828bae4 for snapshot=snaptb0-testExportWithTargetName 2023-07-23 10:06:18,887 INFO [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for dd910dc1df5fc62c86a9daf9bd4a27c9 in 250ms, sequenceid=6, compaction requested=false 2023-07-23 10:06:18,888 DEBUG [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for dd910dc1df5fc62c86a9daf9bd4a27c9: 2023-07-23 10:06:18,888 DEBUG [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1690106776611.dd910dc1df5fc62c86a9daf9bd4a27c9.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-23 10:06:18,888 DEBUG [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 10:06:18,889 DEBUG [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportWithTargetName/dd910dc1df5fc62c86a9daf9bd4a27c9/cf/4c37406da9184e30af2000a1a04acd25] hfiles 2023-07-23 10:06:18,889 DEBUG [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportWithTargetName/dd910dc1df5fc62c86a9daf9bd4a27c9/cf/4c37406da9184e30af2000a1a04acd25 for snapshot=snaptb0-testExportWithTargetName 2023-07-23 10:06:18,894 DEBUG [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 10:06:18,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-23 10:06:18,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-23 10:06:18,899 DEBUG [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-23 10:06:18,920 DEBUG [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1690106776611.62f82f226b28e5cca13eb65698d0e014. completed. 2023-07-23 10:06:18,920 DEBUG [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1690106776611.62f82f226b28e5cca13eb65698d0e014. 2023-07-23 10:06:18,920 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 10:06:18,920 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 10:06:18,920 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:18,920 DEBUG [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1690106776611.dd910dc1df5fc62c86a9daf9bd4a27c9. completed. 2023-07-23 10:06:18,920 DEBUG [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1690106776611.dd910dc1df5fc62c86a9daf9bd4a27c9. 2023-07-23 10:06:18,920 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-23 10:06:18,920 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 10:06:18,920 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 10:06:18,920 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:18,920 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,36599,1690106767729' in zk 2023-07-23 10:06:18,920 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-23 10:06:18,920 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,36827,1690106767853' in zk 2023-07-23 10:06:18,922 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-23 10:06:18,922 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:18,922 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:06:18,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:18,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:06:18,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:06:18,922 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-23 10:06:18,923 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-23 10:06:18,923 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:06:18,923 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:18,923 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-23 10:06:18,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:06:18,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:06:18,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-23 10:06:18,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:18,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:18,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:18,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:06:18,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-23 10:06:18,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:18,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:18,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:18,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,36599,1690106767729': 2023-07-23 10:06:18,928 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36599,1690106767729' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-23 10:06:18,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:18,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:06:18,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:06:18,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:06:18,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:06:18,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-23 10:06:18,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:18,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:18,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:18,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:06:18,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-23 10:06:18,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:18,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:18,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:18,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,36827,1690106767853': 2023-07-23 10:06:18,933 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36827,1690106767853' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-23 10:06:18,933 INFO [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-23 10:06:18,933 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-23 10:06:18,933 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-23 10:06:18,933 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-23 10:06:18,933 INFO [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-23 10:06:18,935 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 10:06:18,935 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 10:06:18,935 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 10:06:18,935 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 10:06:18,935 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 10:06:18,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 10:06:18,935 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 10:06:18,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 10:06:18,935 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:06:18,935 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:06:18,935 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 10:06:18,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 10:06:18,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 10:06:18,935 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:06:18,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:06:18,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:06:18,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:06:18,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:06:18,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:06:18,936 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:18,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:06:18,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:06:18,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:06:18,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:06:18,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 10:06:18,936 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:18,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-23 10:06:18,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 10:06:18,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 10:06:18,937 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:18,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:06:18,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-23 10:06:18,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:18,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:18,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:18,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:06:18,941 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:18,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-23 10:06:18,941 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:18,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:18,942 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:18,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:18,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:18,953 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:06:18,953 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:06:18,953 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:06:18,953 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:06:18,953 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:06:18,953 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:18,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:06:18,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:06:18,953 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:06:18,953 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:06:18,953 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:06:18,953 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:06:18,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:06:18,954 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-23 10:06:18,954 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-23 10:06:18,954 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-23 10:06:18,954 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:06:18,954 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:18,954 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:06:18,954 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:06:18,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:06:18,954 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:06:18,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:06:18,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:06:18,955 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:18,954 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-23 10:06:18,955 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-23 10:06:18,956 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-23 10:06:18,956 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:18,956 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 10:06:18,956 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:18,956 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:18,956 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 10:06:18,956 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 10:06:18,957 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023072392aacb9518fd4d7bb75828f18ae12e4e, hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230723f4964170e0b547d788ff2de9c2a20d5c] mob files 2023-07-23 10:06:18,957 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023072392aacb9518fd4d7bb75828f18ae12e4e 2023-07-23 10:06:18,957 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230723f4964170e0b547d788ff2de9c2a20d5c 2023-07-23 10:06:18,974 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-23 10:06:18,975 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-23 10:06:19,006 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-23 10:06:19,037 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-23 10:06:19,038 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-23 10:06:19,038 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-23 10:06:19,038 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1690106778589Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1690106778974 (+385 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1690106778974Loading Region manifests for snaptb0-testExportWithTargetName at 1690106778974Writing data manifest for snaptb0-testExportWithTargetName at 1690106778979 (+5 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1690106778995 (+16 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1690106779037 (+42 ms) 2023-07-23 10:06:19,040 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-23 10:06:19,043 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 450 msec 2023-07-23 10:06:19,199 DEBUG [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 10:06:19,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-23 10:06:19,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-23 10:06:19,202 INFO [Listener at jenkins-hbase4.apache.org/44565] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/export-test/export-1690106779202 2023-07-23 10:06:19,203 INFO [Listener at jenkins-hbase4.apache.org/44565] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:37479, tgtDir=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/export-test/export-1690106779202, rawTgtDir=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/export-test/export-1690106779202, srcFsUri=hdfs://localhost:37479, srcDir=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528 2023-07-23 10:06:19,243 DEBUG [Listener at jenkins-hbase4.apache.org/44565] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:37479, inputRoot=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528 2023-07-23 10:06:19,243 DEBUG [Listener at jenkins-hbase4.apache.org/44565] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-691628596_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/export-test/export-1690106779202, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/export-test/export-1690106779202/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-23 10:06:19,244 INFO [Listener at jenkins-hbase4.apache.org/44565] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:37479, inputRoot=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528, snapshotDir=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-23 10:06:19,261 INFO [Listener at jenkins-hbase4.apache.org/44565] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/export-test/export-1690106779202/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-23 10:06:19,381 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-23 10:06:19,382 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-23 10:06:19,382 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-23 10:06:19,383 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-23 10:06:19,383 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-23 10:06:19,384 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-23 10:06:19,384 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-23 10:06:19,489 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f0c2d64d-3350-bc69-1c38-d6964a44400f/hadoop-8210629512347824973.jar 2023-07-23 10:06:19,490 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-23 10:06:19,491 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-23 10:06:19,491 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-23 10:06:19,492 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-23 10:06:19,493 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-23 10:06:19,493 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-23 10:06:19,494 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-23 10:06:19,495 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-23 10:06:19,495 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-23 10:06:19,496 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-23 10:06:19,497 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-23 10:06:19,498 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-23 10:06:19,498 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-23 10:06:19,499 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-23 10:06:19,499 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-23 10:06:19,500 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-23 10:06:19,506 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 10:06:19,506 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 10:06:19,507 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 10:06:19,507 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 10:06:19,508 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 10:06:19,509 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 10:06:19,509 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 10:06:20,409 WARN [Listener at jenkins-hbase4.apache.org/44565] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-23 10:06:20,416 INFO [Listener at jenkins-hbase4.apache.org/44565] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-23 10:06:20,432 DEBUG [Listener at jenkins-hbase4.apache.org/44565] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-23 10:06:20,954 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 10:06:20,956 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 10:06:21,688 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690106775176_0001_000001 (auth:SIMPLE) 2023-07-23 10:06:22,670 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-23 10:06:26,989 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690106775176_0001_000001 (auth:SIMPLE) 2023-07-23 10:06:29,257 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690106775176_0001_000001 (auth:SIMPLE) 2023-07-23 10:06:32,029 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690106775176_0001_000001 (auth:SIMPLE) 2023-07-23 10:06:33,388 INFO [Listener at jenkins-hbase4.apache.org/44565] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-23 10:06:33,392 INFO [Listener at jenkins-hbase4.apache.org/44565] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-23 10:06:33,413 INFO [Listener at jenkins-hbase4.apache.org/44565] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-23 10:06:33,413 INFO [Listener at jenkins-hbase4.apache.org/44565] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-23 10:06:33,414 INFO [Listener at jenkins-hbase4.apache.org/44565] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-23 10:06:33,414 DEBUG [Listener at jenkins-hbase4.apache.org/44565] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-165846724_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-23 10:06:33,415 DEBUG [Listener at jenkins-hbase4.apache.org/44565] snapshot.TestExportSnapshot(367): hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-23 10:06:33,415 DEBUG [Listener at jenkins-hbase4.apache.org/44565] snapshot.TestExportSnapshot(367): hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-23 10:06:33,415 DEBUG [Listener at jenkins-hbase4.apache.org/44565] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-165846724_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/export-test/export-1690106779202/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/export-test/export-1690106779202/.hbase-snapshot/testExportWithTargetName 2023-07-23 10:06:33,416 DEBUG [Listener at jenkins-hbase4.apache.org/44565] snapshot.TestExportSnapshot(367): hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/export-test/export-1690106779202/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-23 10:06:33,416 DEBUG [Listener at jenkins-hbase4.apache.org/44565] snapshot.TestExportSnapshot(367): hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/export-test/export-1690106779202/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-23 10:06:33,427 INFO [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-23 10:06:33,432 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-07-23 10:06:33,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-23 10:06:33,446 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690106793446"}]},"ts":"1690106793446"} 2023-07-23 10:06:33,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-23 10:06:33,449 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-23 10:06:33,471 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-23 10:06:33,473 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=62f82f226b28e5cca13eb65698d0e014, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=dd910dc1df5fc62c86a9daf9bd4a27c9, UNASSIGN}] 2023-07-23 10:06:33,474 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=dd910dc1df5fc62c86a9daf9bd4a27c9, UNASSIGN 2023-07-23 10:06:33,476 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=62f82f226b28e5cca13eb65698d0e014, UNASSIGN 2023-07-23 10:06:33,477 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=dd910dc1df5fc62c86a9daf9bd4a27c9, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:33,477 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=62f82f226b28e5cca13eb65698d0e014, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:33,477 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1690106776611.dd910dc1df5fc62c86a9daf9bd4a27c9.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690106793477"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690106793477"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690106793477"}]},"ts":"1690106793477"} 2023-07-23 10:06:33,477 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1690106776611.62f82f226b28e5cca13eb65698d0e014.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690106793477"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690106793477"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690106793477"}]},"ts":"1690106793477"} 2023-07-23 10:06:33,479 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE; CloseRegionProcedure dd910dc1df5fc62c86a9daf9bd4a27c9, server=jenkins-hbase4.apache.org,36827,1690106767853}] 2023-07-23 10:06:33,480 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=22, state=RUNNABLE; CloseRegionProcedure 62f82f226b28e5cca13eb65698d0e014, server=jenkins-hbase4.apache.org,36599,1690106767729}] 2023-07-23 10:06:33,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-23 10:06:33,639 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close dd910dc1df5fc62c86a9daf9bd4a27c9 2023-07-23 10:06:33,639 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 62f82f226b28e5cca13eb65698d0e014 2023-07-23 10:06:33,639 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing dd910dc1df5fc62c86a9daf9bd4a27c9, disabling compactions & flushes 2023-07-23 10:06:33,639 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 62f82f226b28e5cca13eb65698d0e014, disabling compactions & flushes 2023-07-23 10:06:33,640 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1690106776611.dd910dc1df5fc62c86a9daf9bd4a27c9. 2023-07-23 10:06:33,640 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1690106776611.62f82f226b28e5cca13eb65698d0e014. 2023-07-23 10:06:33,640 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1690106776611.dd910dc1df5fc62c86a9daf9bd4a27c9. 2023-07-23 10:06:33,640 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1690106776611.62f82f226b28e5cca13eb65698d0e014. 2023-07-23 10:06:33,640 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1690106776611.dd910dc1df5fc62c86a9daf9bd4a27c9. after waiting 0 ms 2023-07-23 10:06:33,640 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1690106776611.62f82f226b28e5cca13eb65698d0e014. after waiting 0 ms 2023-07-23 10:06:33,640 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1690106776611.dd910dc1df5fc62c86a9daf9bd4a27c9. 2023-07-23 10:06:33,640 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1690106776611.62f82f226b28e5cca13eb65698d0e014. 2023-07-23 10:06:33,659 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportWithTargetName/dd910dc1df5fc62c86a9daf9bd4a27c9/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-23 10:06:33,659 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportWithTargetName/62f82f226b28e5cca13eb65698d0e014/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-23 10:06:33,660 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 10:06:33,660 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 10:06:33,661 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1690106776611.dd910dc1df5fc62c86a9daf9bd4a27c9. 2023-07-23 10:06:33,662 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1690106776611.62f82f226b28e5cca13eb65698d0e014. 2023-07-23 10:06:33,662 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for dd910dc1df5fc62c86a9daf9bd4a27c9: 2023-07-23 10:06:33,662 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 62f82f226b28e5cca13eb65698d0e014: 2023-07-23 10:06:33,665 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 62f82f226b28e5cca13eb65698d0e014 2023-07-23 10:06:33,666 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=62f82f226b28e5cca13eb65698d0e014, regionState=CLOSED 2023-07-23 10:06:33,666 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1690106776611.62f82f226b28e5cca13eb65698d0e014.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690106793665"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690106793665"}]},"ts":"1690106793665"} 2023-07-23 10:06:33,666 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed dd910dc1df5fc62c86a9daf9bd4a27c9 2023-07-23 10:06:33,668 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=dd910dc1df5fc62c86a9daf9bd4a27c9, regionState=CLOSED 2023-07-23 10:06:33,669 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1690106776611.dd910dc1df5fc62c86a9daf9bd4a27c9.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690106793668"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690106793668"}]},"ts":"1690106793668"} 2023-07-23 10:06:33,671 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=22 2023-07-23 10:06:33,671 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=22, state=SUCCESS; CloseRegionProcedure 62f82f226b28e5cca13eb65698d0e014, server=jenkins-hbase4.apache.org,36599,1690106767729 in 188 msec 2023-07-23 10:06:33,674 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=62f82f226b28e5cca13eb65698d0e014, UNASSIGN in 199 msec 2023-07-23 10:06:33,677 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=23 2023-07-23 10:06:33,677 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=23, state=SUCCESS; CloseRegionProcedure dd910dc1df5fc62c86a9daf9bd4a27c9, server=jenkins-hbase4.apache.org,36827,1690106767853 in 196 msec 2023-07-23 10:06:33,680 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=21 2023-07-23 10:06:33,680 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=dd910dc1df5fc62c86a9daf9bd4a27c9, UNASSIGN in 204 msec 2023-07-23 10:06:33,681 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690106793681"}]},"ts":"1690106793681"} 2023-07-23 10:06:33,684 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-23 10:06:33,717 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-23 10:06:33,721 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 283 msec 2023-07-23 10:06:33,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-23 10:06:33,750 INFO [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-23 10:06:33,756 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-07-23 10:06:33,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-23 10:06:33,769 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-23 10:06:33,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-23 10:06:33,771 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-23 10:06:33,775 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39563] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-23 10:06:33,778 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportWithTargetName/62f82f226b28e5cca13eb65698d0e014 2023-07-23 10:06:33,778 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportWithTargetName/dd910dc1df5fc62c86a9daf9bd4a27c9 2023-07-23 10:06:33,781 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportWithTargetName/dd910dc1df5fc62c86a9daf9bd4a27c9/cf, FileablePath, hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportWithTargetName/dd910dc1df5fc62c86a9daf9bd4a27c9/recovered.edits] 2023-07-23 10:06:33,781 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportWithTargetName/62f82f226b28e5cca13eb65698d0e014/cf, FileablePath, hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportWithTargetName/62f82f226b28e5cca13eb65698d0e014/recovered.edits] 2023-07-23 10:06:33,791 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportWithTargetName/dd910dc1df5fc62c86a9daf9bd4a27c9/cf/4c37406da9184e30af2000a1a04acd25 to hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/archive/data/default/testtb-testExportWithTargetName/dd910dc1df5fc62c86a9daf9bd4a27c9/cf/4c37406da9184e30af2000a1a04acd25 2023-07-23 10:06:33,791 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportWithTargetName/62f82f226b28e5cca13eb65698d0e014/cf/34ad58c1aa2e4389a88f86826828bae4 to hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/archive/data/default/testtb-testExportWithTargetName/62f82f226b28e5cca13eb65698d0e014/cf/34ad58c1aa2e4389a88f86826828bae4 2023-07-23 10:06:33,796 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportWithTargetName/dd910dc1df5fc62c86a9daf9bd4a27c9/recovered.edits/9.seqid to hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/archive/data/default/testtb-testExportWithTargetName/dd910dc1df5fc62c86a9daf9bd4a27c9/recovered.edits/9.seqid 2023-07-23 10:06:33,797 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportWithTargetName/dd910dc1df5fc62c86a9daf9bd4a27c9 2023-07-23 10:06:33,797 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportWithTargetName/62f82f226b28e5cca13eb65698d0e014/recovered.edits/9.seqid to hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/archive/data/default/testtb-testExportWithTargetName/62f82f226b28e5cca13eb65698d0e014/recovered.edits/9.seqid 2023-07-23 10:06:33,798 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportWithTargetName/62f82f226b28e5cca13eb65698d0e014 2023-07-23 10:06:33,798 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-23 10:06:33,798 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-23 10:06:33,799 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-07-23 10:06:33,805 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023072392aacb9518fd4d7bb75828f18ae12e4e to hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023072392aacb9518fd4d7bb75828f18ae12e4e 2023-07-23 10:06:33,807 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230723f4964170e0b547d788ff2de9c2a20d5c to hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230723f4964170e0b547d788ff2de9c2a20d5c 2023-07-23 10:06:33,808 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-23 10:06:33,811 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-23 10:06:33,835 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-23 10:06:33,840 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-23 10:06:33,841 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-23 10:06:33,841 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-23 10:06:33,841 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-23 10:06:33,842 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-23 10:06:33,842 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-23 10:06:33,843 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-23 10:06:33,843 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-23 10:06:33,846 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-23 10:06:33,852 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-23 10:06:33,852 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-23 10:06:33,852 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1690106776611.62f82f226b28e5cca13eb65698d0e014.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690106793852"}]},"ts":"9223372036854775807"} 2023-07-23 10:06:33,852 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1690106776611.dd910dc1df5fc62c86a9daf9bd4a27c9.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690106793852"}]},"ts":"9223372036854775807"} 2023-07-23 10:06:33,855 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-23 10:06:33,855 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 62f82f226b28e5cca13eb65698d0e014, NAME => 'testtb-testExportWithTargetName,,1690106776611.62f82f226b28e5cca13eb65698d0e014.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => dd910dc1df5fc62c86a9daf9bd4a27c9, NAME => 'testtb-testExportWithTargetName,1,1690106776611.dd910dc1df5fc62c86a9daf9bd4a27c9.', STARTKEY => '1', ENDKEY => ''}] 2023-07-23 10:06:33,856 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-23 10:06:33,856 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690106793856"}]},"ts":"9223372036854775807"} 2023-07-23 10:06:33,859 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-23 10:06:33,886 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-23 10:06:33,886 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-23 10:06:33,886 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-23 10:06:33,886 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-23 10:06:33,886 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:06:33,886 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:06:33,886 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:06:33,886 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:06:33,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-23 10:06:33,918 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-23 10:06:33,921 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 161 msec 2023-07-23 10:06:33,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-23 10:06:33,992 INFO [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-23 10:06:34,033 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-23 10:06:34,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-23 10:06:34,041 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-07-23 10:06:34,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-23 10:06:34,104 INFO [Listener at jenkins-hbase4.apache.org/44565] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=752 (was 705) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1315 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-165846724_17 at /127.0.0.1:54184 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1575588394) connection to jenkins-hbase4.apache.org/172.31.14.131:34205 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1575588394) connection to jenkins-hbase4.apache.org/172.31.14.131:33251 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: (jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f0c2d64d-3350-bc69-1c38-d6964a44400f/cluster_e785ae9c-bfd7-c886-b4ec-cc83daa5c072/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f0c2d64d-3350-bc69-1c38-d6964a44400f/cluster_e785ae9c-bfd7-c886-b4ec-cc83daa5c072/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f0c2d64d-3350-bc69-1c38-d6964a44400f/cluster_e785ae9c-bfd7-c886-b4ec-cc83daa5c072/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3cfc6090-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-165846724_17 at /127.0.0.1:33880 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f0c2d64d-3350-bc69-1c38-d6964a44400f/cluster_e785ae9c-bfd7-c886-b4ec-cc83daa5c072/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f0c2d64d-3350-bc69-1c38-d6964a44400f/cluster_e785ae9c-bfd7-c886-b4ec-cc83daa5c072/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-165846724_17 at /127.0.0.1:39262 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3cfc6090-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3cfc6090-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1965787460_1 at /127.0.0.1:54156 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f0c2d64d-3350-bc69-1c38-d6964a44400f/cluster_e785ae9c-bfd7-c886-b4ec-cc83daa5c072/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3cfc6090-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=920 (was 900) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=260 (was 153) - SystemLoadAverage LEAK? -, ProcessCount=182 (was 173) - ProcessCount LEAK? -, AvailableMemoryMB=6111 (was 8334) 2023-07-23 10:06:34,104 WARN [Listener at jenkins-hbase4.apache.org/44565] hbase.ResourceChecker(130): Thread=752 is superior to 500 2023-07-23 10:06:34,135 INFO [Listener at jenkins-hbase4.apache.org/44565] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=752, OpenFileDescriptor=920, MaxFileDescriptor=60000, SystemLoadAverage=260, ProcessCount=182, AvailableMemoryMB=6619 2023-07-23 10:06:34,136 WARN [Listener at jenkins-hbase4.apache.org/44565] hbase.ResourceChecker(130): Thread=752 is superior to 500 2023-07-23 10:06:34,138 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-23 10:06:34,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-23 10:06:34,146 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-23 10:06:34,148 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-23 10:06:34,149 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-23 10:06:34,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-23 10:06:34,152 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportFileSystemState/433b5c9da757baa1b99f953417ba4e80 2023-07-23 10:06:34,152 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportFileSystemState/2b2ead90d115ba361ac7bdc982c18bbd 2023-07-23 10:06:34,153 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportFileSystemState/2b2ead90d115ba361ac7bdc982c18bbd empty. 2023-07-23 10:06:34,153 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportFileSystemState/433b5c9da757baa1b99f953417ba4e80 empty. 2023-07-23 10:06:34,153 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportFileSystemState/2b2ead90d115ba361ac7bdc982c18bbd 2023-07-23 10:06:34,153 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportFileSystemState/433b5c9da757baa1b99f953417ba4e80 2023-07-23 10:06:34,154 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-23 10:06:34,184 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-23 10:06:34,186 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 433b5c9da757baa1b99f953417ba4e80, NAME => 'testtb-testExportFileSystemState,,1690106794138.433b5c9da757baa1b99f953417ba4e80.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp 2023-07-23 10:06:34,186 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 2b2ead90d115ba361ac7bdc982c18bbd, NAME => 'testtb-testExportFileSystemState,1,1690106794138.2b2ead90d115ba361ac7bdc982c18bbd.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp 2023-07-23 10:06:34,231 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1690106794138.433b5c9da757baa1b99f953417ba4e80.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 10:06:34,232 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 433b5c9da757baa1b99f953417ba4e80, disabling compactions & flushes 2023-07-23 10:06:34,232 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1690106794138.433b5c9da757baa1b99f953417ba4e80. 2023-07-23 10:06:34,232 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1690106794138.433b5c9da757baa1b99f953417ba4e80. 2023-07-23 10:06:34,232 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1690106794138.433b5c9da757baa1b99f953417ba4e80. after waiting 0 ms 2023-07-23 10:06:34,232 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1690106794138.433b5c9da757baa1b99f953417ba4e80. 2023-07-23 10:06:34,232 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1690106794138.433b5c9da757baa1b99f953417ba4e80. 2023-07-23 10:06:34,232 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 433b5c9da757baa1b99f953417ba4e80: 2023-07-23 10:06:34,232 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1690106794138.2b2ead90d115ba361ac7bdc982c18bbd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 10:06:34,233 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 2b2ead90d115ba361ac7bdc982c18bbd, disabling compactions & flushes 2023-07-23 10:06:34,233 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1690106794138.2b2ead90d115ba361ac7bdc982c18bbd. 2023-07-23 10:06:34,233 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1690106794138.2b2ead90d115ba361ac7bdc982c18bbd. 2023-07-23 10:06:34,234 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1690106794138.2b2ead90d115ba361ac7bdc982c18bbd. after waiting 1 ms 2023-07-23 10:06:34,234 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1690106794138.2b2ead90d115ba361ac7bdc982c18bbd. 2023-07-23 10:06:34,234 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1690106794138.2b2ead90d115ba361ac7bdc982c18bbd. 2023-07-23 10:06:34,234 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 2b2ead90d115ba361ac7bdc982c18bbd: 2023-07-23 10:06:34,236 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-23 10:06:34,238 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1690106794138.433b5c9da757baa1b99f953417ba4e80.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690106794237"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690106794237"}]},"ts":"1690106794237"} 2023-07-23 10:06:34,238 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1690106794138.2b2ead90d115ba361ac7bdc982c18bbd.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690106794237"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690106794237"}]},"ts":"1690106794237"} 2023-07-23 10:06:34,240 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-23 10:06:34,241 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-23 10:06:34,242 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690106794241"}]},"ts":"1690106794241"} 2023-07-23 10:06:34,243 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-23 10:06:34,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-23 10:06:34,302 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-23 10:06:34,303 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-23 10:06:34,303 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-23 10:06:34,303 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-23 10:06:34,303 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-23 10:06:34,304 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=433b5c9da757baa1b99f953417ba4e80, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=2b2ead90d115ba361ac7bdc982c18bbd, ASSIGN}] 2023-07-23 10:06:34,307 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=433b5c9da757baa1b99f953417ba4e80, ASSIGN 2023-07-23 10:06:34,307 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=2b2ead90d115ba361ac7bdc982c18bbd, ASSIGN 2023-07-23 10:06:34,308 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=433b5c9da757baa1b99f953417ba4e80, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36599,1690106767729; forceNewPlan=false, retain=false 2023-07-23 10:06:34,308 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=2b2ead90d115ba361ac7bdc982c18bbd, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36827,1690106767853; forceNewPlan=false, retain=false 2023-07-23 10:06:34,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-23 10:06:34,458 INFO [jenkins-hbase4:34097] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-23 10:06:34,461 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=2b2ead90d115ba361ac7bdc982c18bbd, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:34,461 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=433b5c9da757baa1b99f953417ba4e80, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:34,461 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1690106794138.2b2ead90d115ba361ac7bdc982c18bbd.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690106794461"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690106794461"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690106794461"}]},"ts":"1690106794461"} 2023-07-23 10:06:34,461 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1690106794138.433b5c9da757baa1b99f953417ba4e80.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690106794461"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690106794461"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690106794461"}]},"ts":"1690106794461"} 2023-07-23 10:06:34,463 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE; OpenRegionProcedure 2b2ead90d115ba361ac7bdc982c18bbd, server=jenkins-hbase4.apache.org,36827,1690106767853}] 2023-07-23 10:06:34,464 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure 433b5c9da757baa1b99f953417ba4e80, server=jenkins-hbase4.apache.org,36599,1690106767729}] 2023-07-23 10:06:34,619 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1690106794138.2b2ead90d115ba361ac7bdc982c18bbd. 2023-07-23 10:06:34,619 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2b2ead90d115ba361ac7bdc982c18bbd, NAME => 'testtb-testExportFileSystemState,1,1690106794138.2b2ead90d115ba361ac7bdc982c18bbd.', STARTKEY => '1', ENDKEY => ''} 2023-07-23 10:06:34,620 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1690106794138.433b5c9da757baa1b99f953417ba4e80. 2023-07-23 10:06:34,620 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 433b5c9da757baa1b99f953417ba4e80, NAME => 'testtb-testExportFileSystemState,,1690106794138.433b5c9da757baa1b99f953417ba4e80.', STARTKEY => '', ENDKEY => '1'} 2023-07-23 10:06:34,620 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1690106794138.2b2ead90d115ba361ac7bdc982c18bbd. service=AccessControlService 2023-07-23 10:06:34,620 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 10:06:34,620 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 2b2ead90d115ba361ac7bdc982c18bbd 2023-07-23 10:06:34,620 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1690106794138.433b5c9da757baa1b99f953417ba4e80. service=AccessControlService 2023-07-23 10:06:34,620 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1690106794138.2b2ead90d115ba361ac7bdc982c18bbd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 10:06:34,621 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 10:06:34,621 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2b2ead90d115ba361ac7bdc982c18bbd 2023-07-23 10:06:34,621 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 433b5c9da757baa1b99f953417ba4e80 2023-07-23 10:06:34,621 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2b2ead90d115ba361ac7bdc982c18bbd 2023-07-23 10:06:34,621 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1690106794138.433b5c9da757baa1b99f953417ba4e80.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 10:06:34,621 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 433b5c9da757baa1b99f953417ba4e80 2023-07-23 10:06:34,621 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 433b5c9da757baa1b99f953417ba4e80 2023-07-23 10:06:34,622 INFO [StoreOpener-433b5c9da757baa1b99f953417ba4e80-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 433b5c9da757baa1b99f953417ba4e80 2023-07-23 10:06:34,622 INFO [StoreOpener-2b2ead90d115ba361ac7bdc982c18bbd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 2b2ead90d115ba361ac7bdc982c18bbd 2023-07-23 10:06:34,624 DEBUG [StoreOpener-433b5c9da757baa1b99f953417ba4e80-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemState/433b5c9da757baa1b99f953417ba4e80/cf 2023-07-23 10:06:34,624 DEBUG [StoreOpener-433b5c9da757baa1b99f953417ba4e80-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemState/433b5c9da757baa1b99f953417ba4e80/cf 2023-07-23 10:06:34,624 DEBUG [StoreOpener-2b2ead90d115ba361ac7bdc982c18bbd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemState/2b2ead90d115ba361ac7bdc982c18bbd/cf 2023-07-23 10:06:34,624 DEBUG [StoreOpener-2b2ead90d115ba361ac7bdc982c18bbd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemState/2b2ead90d115ba361ac7bdc982c18bbd/cf 2023-07-23 10:06:34,624 INFO [StoreOpener-433b5c9da757baa1b99f953417ba4e80-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 433b5c9da757baa1b99f953417ba4e80 columnFamilyName cf 2023-07-23 10:06:34,624 INFO [StoreOpener-2b2ead90d115ba361ac7bdc982c18bbd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2b2ead90d115ba361ac7bdc982c18bbd columnFamilyName cf 2023-07-23 10:06:34,626 INFO [StoreOpener-2b2ead90d115ba361ac7bdc982c18bbd-1] regionserver.HStore(310): Store=2b2ead90d115ba361ac7bdc982c18bbd/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 10:06:34,626 INFO [StoreOpener-433b5c9da757baa1b99f953417ba4e80-1] regionserver.HStore(310): Store=433b5c9da757baa1b99f953417ba4e80/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 10:06:34,629 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemState/2b2ead90d115ba361ac7bdc982c18bbd 2023-07-23 10:06:34,629 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemState/433b5c9da757baa1b99f953417ba4e80 2023-07-23 10:06:34,629 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemState/433b5c9da757baa1b99f953417ba4e80 2023-07-23 10:06:34,629 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemState/2b2ead90d115ba361ac7bdc982c18bbd 2023-07-23 10:06:34,632 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 433b5c9da757baa1b99f953417ba4e80 2023-07-23 10:06:34,632 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2b2ead90d115ba361ac7bdc982c18bbd 2023-07-23 10:06:34,635 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemState/2b2ead90d115ba361ac7bdc982c18bbd/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 10:06:34,635 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemState/433b5c9da757baa1b99f953417ba4e80/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 10:06:34,635 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2b2ead90d115ba361ac7bdc982c18bbd; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74008350, jitterRate=0.10281035304069519}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 10:06:34,635 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 433b5c9da757baa1b99f953417ba4e80; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74378052, jitterRate=0.10831934213638306}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 10:06:34,635 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2b2ead90d115ba361ac7bdc982c18bbd: 2023-07-23 10:06:34,635 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 433b5c9da757baa1b99f953417ba4e80: 2023-07-23 10:06:34,636 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1690106794138.433b5c9da757baa1b99f953417ba4e80., pid=31, masterSystemTime=1690106794617 2023-07-23 10:06:34,636 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1690106794138.2b2ead90d115ba361ac7bdc982c18bbd., pid=30, masterSystemTime=1690106794616 2023-07-23 10:06:34,638 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1690106794138.433b5c9da757baa1b99f953417ba4e80. 2023-07-23 10:06:34,638 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1690106794138.433b5c9da757baa1b99f953417ba4e80. 2023-07-23 10:06:34,639 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=433b5c9da757baa1b99f953417ba4e80, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:34,639 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1690106794138.2b2ead90d115ba361ac7bdc982c18bbd. 2023-07-23 10:06:34,639 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1690106794138.2b2ead90d115ba361ac7bdc982c18bbd. 2023-07-23 10:06:34,639 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1690106794138.433b5c9da757baa1b99f953417ba4e80.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690106794639"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690106794639"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690106794639"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690106794639"}]},"ts":"1690106794639"} 2023-07-23 10:06:34,640 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=2b2ead90d115ba361ac7bdc982c18bbd, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:34,640 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1690106794138.2b2ead90d115ba361ac7bdc982c18bbd.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690106794640"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690106794640"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690106794640"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690106794640"}]},"ts":"1690106794640"} 2023-07-23 10:06:34,644 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=28 2023-07-23 10:06:34,645 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure 433b5c9da757baa1b99f953417ba4e80, server=jenkins-hbase4.apache.org,36599,1690106767729 in 177 msec 2023-07-23 10:06:34,647 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=29 2023-07-23 10:06:34,647 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=433b5c9da757baa1b99f953417ba4e80, ASSIGN in 342 msec 2023-07-23 10:06:34,650 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=29, state=SUCCESS; OpenRegionProcedure 2b2ead90d115ba361ac7bdc982c18bbd, server=jenkins-hbase4.apache.org,36827,1690106767853 in 179 msec 2023-07-23 10:06:34,652 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=27 2023-07-23 10:06:34,652 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=2b2ead90d115ba361ac7bdc982c18bbd, ASSIGN in 347 msec 2023-07-23 10:06:34,653 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-23 10:06:34,653 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690106794653"}]},"ts":"1690106794653"} 2023-07-23 10:06:34,655 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-23 10:06:34,687 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-23 10:06:34,687 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-23 10:06:34,689 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39563] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-23 10:06:34,694 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:06:34,694 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:06:34,694 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:06:34,694 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:06:34,702 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-23 10:06:34,702 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-23 10:06:34,702 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-23 10:06:34,702 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-23 10:06:34,706 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 562 msec 2023-07-23 10:06:34,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-23 10:06:34,753 INFO [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-23 10:06:34,756 DEBUG [Listener at jenkins-hbase4.apache.org/44565] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-23 10:06:34,756 DEBUG [Listener at jenkins-hbase4.apache.org/44565] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1690106794138.433b5c9da757baa1b99f953417ba4e80. 2023-07-23 10:06:34,758 INFO [Listener at jenkins-hbase4.apache.org/44565] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 10:06:34,773 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-23 10:06:34,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690106794773 (current time:1690106794773). 2023-07-23 10:06:34,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-23 10:06:34,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] zookeeper.ReadOnlyZKClient(139): Connect 0x5d589ef5 to 127.0.0.1:55181 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 10:06:34,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2ab59a4d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 10:06:34,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 10:06:34,792 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60294, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 10:06:34,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5d589ef5 to 127.0.0.1:55181 2023-07-23 10:06:34,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 10:06:34,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] zookeeper.ReadOnlyZKClient(139): Connect 0x74e85b05 to 127.0.0.1:55181 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 10:06:34,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6d5ecc5b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 10:06:34,805 DEBUG [hconnection-0x6bbf544f-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 10:06:34,806 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60298, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 10:06:34,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x74e85b05 to 127.0.0.1:55181 2023-07-23 10:06:34,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 10:06:34,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-23 10:06:34,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-23 10:06:34,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-23 10:06:34,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-23 10:06:34,818 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-23 10:06:34,819 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1690107394819 2023-07-23 10:06:34,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-23 10:06:34,820 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-23 10:06:34,821 DEBUG [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-23 10:06:34,821 DEBUG [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-23 10:06:34,822 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-23 10:06:34,823 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-23 10:06:34,824 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-07-23 10:06:34,825 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-23 10:06:34,826 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1690107394826 2023-07-23 10:06:34,845 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:34,845 INFO [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-23 10:06:34,845 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:06:34,846 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-23 10:06:34,846 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-23 10:06:34,847 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:34,847 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:34,849 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:06:34,849 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:06:34,849 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:06:34,849 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:06:34,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:06:34,849 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:06:34,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:06:34,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:34,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:34,850 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:34,850 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:34,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-23 10:06:34,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:34,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-23 10:06:34,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:34,851 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-23 10:06:34,851 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-23 10:06:34,851 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:34,851 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-23 10:06:34,851 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:06:34,852 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:34,853 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:06:34,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:06:34,852 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:34,853 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-23 10:06:34,853 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-23 10:06:34,853 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:06:34,853 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-23 10:06:34,854 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-23 10:06:34,854 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:34,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:34,854 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-23 10:06:34,855 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39563,1690106767800' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-23 10:06:34,854 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36599,1690106767729' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-23 10:06:34,854 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:34,855 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:34,855 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:34,855 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-23 10:06:34,861 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:34,861 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:34,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-23 10:06:34,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:34,861 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:34,861 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:34,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:34,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:06:34,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:06:34,861 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-23 10:06:34,861 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 10:06:34,861 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:34,862 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 10:06:34,862 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:34,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:06:34,862 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-23 10:06:34,862 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:06:34,863 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-23 10:06:34,863 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-23 10:06:34,863 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36827,1690106767853' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-23 10:06:34,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:06:34,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:34,864 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:34,864 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:34,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:34,865 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:34,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:34,865 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 10:06:34,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:34,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:06:34,866 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36599,1690106767729' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-23 10:06:34,866 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@57d4418c[Count = 1] remaining members to acquire global barrier 2023-07-23 10:06:34,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:34,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:06:34,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:06:34,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:06:34,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:06:34,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:34,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:34,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:34,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:34,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:06:34,869 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36827,1690106767853' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-23 10:06:34,869 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@57d4418c[Count = 0] remaining members to acquire global barrier 2023-07-23 10:06:34,869 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-23 10:06:34,869 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:34,870 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:34,870 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:34,870 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:34,871 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:34,870 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:34,871 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:34,871 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:34,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:34,871 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-23 10:06:34,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:34,871 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 10:06:34,871 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 10:06:34,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:34,871 DEBUG [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1690106794138.433b5c9da757baa1b99f953417ba4e80. 2023-07-23 10:06:34,871 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-23 10:06:34,871 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-23 10:06:34,871 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:34,872 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-23 10:06:34,871 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-23 10:06:34,872 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 10:06:34,872 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39563,1690106767800' in zk 2023-07-23 10:06:34,872 DEBUG [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1690106794138.2b2ead90d115ba361ac7bdc982c18bbd. 2023-07-23 10:06:34,872 DEBUG [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1690106794138.2b2ead90d115ba361ac7bdc982c18bbd. started... 2023-07-23 10:06:34,871 DEBUG [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1690106794138.433b5c9da757baa1b99f953417ba4e80. started... 2023-07-23 10:06:34,872 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 10:06:34,873 DEBUG [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2b2ead90d115ba361ac7bdc982c18bbd: 2023-07-23 10:06:34,873 DEBUG [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 433b5c9da757baa1b99f953417ba4e80: 2023-07-23 10:06:34,873 DEBUG [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1690106794138.2b2ead90d115ba361ac7bdc982c18bbd.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:34,873 DEBUG [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1690106794138.433b5c9da757baa1b99f953417ba4e80.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:34,873 DEBUG [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 10:06:34,874 DEBUG [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 10:06:34,874 DEBUG [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-23 10:06:34,874 DEBUG [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-23 10:06:34,875 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-23 10:06:34,875 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:06:34,875 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-23 10:06:34,917 DEBUG [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1690106794138.2b2ead90d115ba361ac7bdc982c18bbd. completed. 2023-07-23 10:06:34,917 DEBUG [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1690106794138.2b2ead90d115ba361ac7bdc982c18bbd. 2023-07-23 10:06:34,917 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 10:06:34,917 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 10:06:34,917 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:34,918 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-23 10:06:34,918 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,36827,1690106767853' in zk 2023-07-23 10:06:34,919 DEBUG [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1690106794138.433b5c9da757baa1b99f953417ba4e80. completed. 2023-07-23 10:06:34,919 DEBUG [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1690106794138.433b5c9da757baa1b99f953417ba4e80. 2023-07-23 10:06:34,919 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 10:06:34,919 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 10:06:34,919 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:34,919 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-23 10:06:34,919 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,36599,1690106767729' in zk 2023-07-23 10:06:34,921 DEBUG [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 10:06:34,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-23 10:06:34,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-23 10:06:34,923 DEBUG [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-23 10:06:34,923 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:34,923 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-23 10:06:34,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:34,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:06:34,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:06:34,923 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:06:34,923 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-23 10:06:34,925 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:34,925 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-23 10:06:34,925 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:06:34,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:06:34,925 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-23 10:06:34,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:06:34,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:34,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:34,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:34,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:34,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:06:34,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:34,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:34,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:34,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:34,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,36827,1690106767853': 2023-07-23 10:06:34,936 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36827,1690106767853' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-23 10:06:34,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:34,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:06:34,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:06:34,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:06:34,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:06:34,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:34,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:34,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:34,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:34,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:06:34,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:34,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:34,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:34,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:34,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,36599,1690106767729': 2023-07-23 10:06:34,941 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36599,1690106767729' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-23 10:06:34,941 INFO [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-23 10:06:34,942 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-23 10:06:34,942 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-23 10:06:34,942 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:34,942 INFO [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-23 10:06:34,944 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:34,944 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:34,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:34,944 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:34,944 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:34,944 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:34,944 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:34,944 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:34,944 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:06:34,944 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:06:34,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:34,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:06:34,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:06:34,944 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:06:34,945 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:34,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:34,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:34,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:06:34,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:06:34,945 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:34,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:06:34,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:06:34,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:06:34,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:06:34,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:06:34,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:34,949 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:34,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:34,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:34,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:34,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:06:34,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:34,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:34,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:34,960 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:34,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:34,960 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:34,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:06:34,961 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:34,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:34,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:34,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:34,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:34,965 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:34,965 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:06:34,965 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:34,965 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:06:34,965 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:34,965 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:34,965 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:34,965 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:34,965 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:06:34,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:06:34,965 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:06:34,965 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:06:34,965 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:34,965 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:06:34,965 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:06:34,965 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:34,967 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:06:34,965 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:06:34,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:06:34,967 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:34,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:06:34,967 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-23 10:06:34,967 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:34,967 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:34,967 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:06:34,967 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:06:34,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:06:34,967 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:34,967 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:34,967 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:06:34,967 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-23 10:06:34,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:06:34,968 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:06:34,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:06:34,968 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-23 10:06:34,981 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:34,982 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:35,008 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:35,036 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-23 10:06:35,036 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:35,036 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:35,036 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1690106794820Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1690106794981 (+161 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1690106794981Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1690106794981Writing data manifest for emptySnaptb0-testExportFileSystemState at 1690106794988 (+7 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1690106795000 (+12 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1690106795036 (+36 ms) 2023-07-23 10:06:35,039 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-23 10:06:35,041 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 218 msec 2023-07-23 10:06:35,123 DEBUG [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 10:06:35,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-23 10:06:35,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-23 10:06:35,128 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36599] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1690106794138.433b5c9da757baa1b99f953417ba4e80. with WAL disabled. Data may be lost in the event of a crash. 2023-07-23 10:06:35,129 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36827] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1690106794138.2b2ead90d115ba361ac7bdc982c18bbd. with WAL disabled. Data may be lost in the event of a crash. 2023-07-23 10:06:35,133 DEBUG [Listener at jenkins-hbase4.apache.org/44565] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-23 10:06:35,133 DEBUG [Listener at jenkins-hbase4.apache.org/44565] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1690106794138.433b5c9da757baa1b99f953417ba4e80. 2023-07-23 10:06:35,134 INFO [Listener at jenkins-hbase4.apache.org/44565] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 10:06:35,146 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-23 10:06:35,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690106795146 (current time:1690106795146). 2023-07-23 10:06:35,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-23 10:06:35,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] zookeeper.ReadOnlyZKClient(139): Connect 0x6de0de03 to 127.0.0.1:55181 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 10:06:35,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5078db06, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 10:06:35,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 10:06:35,158 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60302, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 10:06:35,159 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6de0de03 to 127.0.0.1:55181 2023-07-23 10:06:35,159 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 10:06:35,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] zookeeper.ReadOnlyZKClient(139): Connect 0x72584a8e to 127.0.0.1:55181 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 10:06:35,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@f15cad9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 10:06:35,169 DEBUG [hconnection-0x273785b1-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 10:06:35,171 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60312, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 10:06:35,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x72584a8e to 127.0.0.1:55181 2023-07-23 10:06:35,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 10:06:35,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-23 10:06:35,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-23 10:06:35,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-23 10:06:35,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-23 10:06:35,181 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-23 10:06:35,182 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1690107395182 2023-07-23 10:06:35,182 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-23 10:06:35,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-23 10:06:35,183 DEBUG [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-23 10:06:35,183 DEBUG [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-23 10:06:35,184 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-23 10:06:35,184 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-23 10:06:35,186 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-07-23 10:06:35,187 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-23 10:06:35,188 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1690107395188 2023-07-23 10:06:35,204 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-23 10:06:35,204 INFO [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-23 10:06:35,204 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:06:35,205 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-23 10:06:35,205 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-23 10:06:35,206 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 10:06:35,206 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-23 10:06:35,208 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:06:35,208 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:06:35,209 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:06:35,209 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:35,208 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:06:35,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:06:35,209 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:06:35,209 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:06:35,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:06:35,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:06:35,209 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:35,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-23 10:06:35,209 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:35,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-23 10:06:35,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-23 10:06:35,210 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 10:06:35,210 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 10:06:35,210 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 10:06:35,210 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:35,210 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-23 10:06:35,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-23 10:06:35,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-23 10:06:35,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-23 10:06:35,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-23 10:06:35,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-23 10:06:35,211 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-23 10:06:35,211 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-23 10:06:35,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-23 10:06:35,211 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-23 10:06:35,211 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-23 10:06:35,211 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-23 10:06:35,211 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:06:35,211 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-23 10:06:35,212 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-23 10:06:35,212 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-23 10:06:35,212 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-23 10:06:35,212 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-23 10:06:35,212 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:06:35,212 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-23 10:06:35,213 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-23 10:06:35,212 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36827,1690106767853' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-23 10:06:35,213 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-23 10:06:35,213 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39563,1690106767800' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-23 10:06:35,213 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:06:35,214 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-23 10:06:35,214 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-23 10:06:35,214 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36599,1690106767729' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-23 10:06:35,216 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 10:06:35,216 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:35,216 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 10:06:35,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:35,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:06:35,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:06:35,217 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 10:06:35,217 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 10:06:35,217 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 10:06:35,217 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 10:06:35,217 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 10:06:35,217 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:35,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:06:35,217 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 10:06:35,217 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 10:06:35,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:06:35,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-23 10:06:35,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:35,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:35,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:35,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:06:35,219 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36827,1690106767853' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-23 10:06:35,219 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@62b5e347[Count = 1] remaining members to acquire global barrier 2023-07-23 10:06:35,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:35,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:06:35,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:06:35,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:06:35,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:06:35,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-23 10:06:35,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:35,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:35,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:35,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:06:35,221 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36599,1690106767729' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-23 10:06:35,221 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@62b5e347[Count = 0] remaining members to acquire global barrier 2023-07-23 10:06:35,221 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-23 10:06:35,221 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 10:06:35,223 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 10:06:35,223 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 10:06:35,223 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 10:06:35,223 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 10:06:35,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 10:06:35,223 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 10:06:35,223 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-23 10:06:35,223 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 10:06:35,223 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:35,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 10:06:35,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 10:06:35,223 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-23 10:06:35,223 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-23 10:06:35,223 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-23 10:06:35,223 DEBUG [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1690106794138.2b2ead90d115ba361ac7bdc982c18bbd. 2023-07-23 10:06:35,223 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:35,223 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-23 10:06:35,223 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 10:06:35,223 DEBUG [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1690106794138.433b5c9da757baa1b99f953417ba4e80. 2023-07-23 10:06:35,223 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 10:06:35,223 DEBUG [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1690106794138.433b5c9da757baa1b99f953417ba4e80. started... 2023-07-23 10:06:35,223 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 10:06:35,224 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 10:06:35,223 DEBUG [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1690106794138.2b2ead90d115ba361ac7bdc982c18bbd. started... 2023-07-23 10:06:35,223 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39563,1690106767800' in zk 2023-07-23 10:06:35,224 INFO [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 433b5c9da757baa1b99f953417ba4e80 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-23 10:06:35,224 INFO [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 2b2ead90d115ba361ac7bdc982c18bbd 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-23 10:06:35,226 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-23 10:06:35,226 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:06:35,226 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-23 10:06:35,254 INFO [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307237fe8bb6de276435ebf5a3d1437dac242 to hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202307237fe8bb6de276435ebf5a3d1437dac242 2023-07-23 10:06:35,259 INFO [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307231f6e054ba8454caa8dd145bf73d4da9b to hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202307231f6e054ba8454caa8dd145bf73d4da9b 2023-07-23 10:06:35,281 INFO [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemState/433b5c9da757baa1b99f953417ba4e80/.tmp/cf/a59611269c29401290f82222262c5b7e 2023-07-23 10:06:35,283 DEBUG [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 10:06:35,285 INFO [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemState/2b2ead90d115ba361ac7bdc982c18bbd/.tmp/cf/54b36d93ca714f46b12c2e6d3445e45a 2023-07-23 10:06:35,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-23 10:06:35,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-23 10:06:35,285 DEBUG [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-23 10:06:35,289 DEBUG [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemState/433b5c9da757baa1b99f953417ba4e80/.tmp/cf/a59611269c29401290f82222262c5b7e as hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemState/433b5c9da757baa1b99f953417ba4e80/cf/a59611269c29401290f82222262c5b7e 2023-07-23 10:06:35,291 DEBUG [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemState/2b2ead90d115ba361ac7bdc982c18bbd/.tmp/cf/54b36d93ca714f46b12c2e6d3445e45a as hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemState/2b2ead90d115ba361ac7bdc982c18bbd/cf/54b36d93ca714f46b12c2e6d3445e45a 2023-07-23 10:06:35,296 INFO [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemState/433b5c9da757baa1b99f953417ba4e80/cf/a59611269c29401290f82222262c5b7e, entries=2, sequenceid=6, filesize=5.2 K 2023-07-23 10:06:35,297 INFO [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 433b5c9da757baa1b99f953417ba4e80 in 73ms, sequenceid=6, compaction requested=false 2023-07-23 10:06:35,297 DEBUG [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-23 10:06:35,297 DEBUG [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 433b5c9da757baa1b99f953417ba4e80: 2023-07-23 10:06:35,298 DEBUG [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1690106794138.433b5c9da757baa1b99f953417ba4e80.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-23 10:06:35,298 DEBUG [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 10:06:35,298 DEBUG [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemState/433b5c9da757baa1b99f953417ba4e80/cf/a59611269c29401290f82222262c5b7e] hfiles 2023-07-23 10:06:35,298 DEBUG [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemState/433b5c9da757baa1b99f953417ba4e80/cf/a59611269c29401290f82222262c5b7e for snapshot=snaptb0-testExportFileSystemState 2023-07-23 10:06:35,299 INFO [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemState/2b2ead90d115ba361ac7bdc982c18bbd/cf/54b36d93ca714f46b12c2e6d3445e45a, entries=48, sequenceid=6, filesize=13.0 K 2023-07-23 10:06:35,300 INFO [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 2b2ead90d115ba361ac7bdc982c18bbd in 76ms, sequenceid=6, compaction requested=false 2023-07-23 10:06:35,301 DEBUG [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2b2ead90d115ba361ac7bdc982c18bbd: 2023-07-23 10:06:35,301 DEBUG [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1690106794138.2b2ead90d115ba361ac7bdc982c18bbd.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-23 10:06:35,301 DEBUG [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 10:06:35,301 DEBUG [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemState/2b2ead90d115ba361ac7bdc982c18bbd/cf/54b36d93ca714f46b12c2e6d3445e45a] hfiles 2023-07-23 10:06:35,301 DEBUG [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemState/2b2ead90d115ba361ac7bdc982c18bbd/cf/54b36d93ca714f46b12c2e6d3445e45a for snapshot=snaptb0-testExportFileSystemState 2023-07-23 10:06:35,316 DEBUG [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1690106794138.433b5c9da757baa1b99f953417ba4e80. completed. 2023-07-23 10:06:35,316 DEBUG [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1690106794138.433b5c9da757baa1b99f953417ba4e80. 2023-07-23 10:06:35,316 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 10:06:35,316 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 10:06:35,316 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:35,316 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-23 10:06:35,316 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,36599,1690106767729' in zk 2023-07-23 10:06:35,318 DEBUG [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1690106794138.2b2ead90d115ba361ac7bdc982c18bbd. completed. 2023-07-23 10:06:35,318 DEBUG [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1690106794138.2b2ead90d115ba361ac7bdc982c18bbd. 2023-07-23 10:06:35,318 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 10:06:35,318 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 10:06:35,318 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:35,318 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-23 10:06:35,318 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,36827,1690106767853' in zk 2023-07-23 10:06:35,321 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-23 10:06:35,321 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:35,322 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:06:35,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:35,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:06:35,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:06:35,322 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-23 10:06:35,324 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:35,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:06:35,324 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-23 10:06:35,324 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:06:35,325 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-23 10:06:35,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:06:35,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-23 10:06:35,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:35,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:35,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:35,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:06:35,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-23 10:06:35,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:35,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:35,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:35,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,36599,1690106767729': 2023-07-23 10:06:35,329 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36599,1690106767729' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-23 10:06:35,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:35,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:06:35,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:06:35,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:06:35,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:06:35,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-23 10:06:35,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:35,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:35,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:35,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:06:35,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-23 10:06:35,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:35,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:35,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:35,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,36827,1690106767853': 2023-07-23 10:06:35,333 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36827,1690106767853' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-23 10:06:35,333 INFO [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-23 10:06:35,333 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-23 10:06:35,333 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-23 10:06:35,333 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-23 10:06:35,333 INFO [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-23 10:06:35,335 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 10:06:35,335 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 10:06:35,335 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 10:06:35,336 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 10:06:35,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 10:06:35,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:06:35,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:06:35,335 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 10:06:35,335 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:06:35,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 10:06:35,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 10:06:35,335 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 10:06:35,336 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:06:35,335 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:06:35,336 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 10:06:35,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:06:35,336 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:35,336 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:06:35,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:06:35,336 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:06:35,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:06:35,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 10:06:35,337 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:35,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-23 10:06:35,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 10:06:35,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 10:06:35,338 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:35,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:06:35,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:06:35,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:06:35,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-23 10:06:35,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 10:06:35,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:35,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:35,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:35,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:06:35,340 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:35,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-23 10:06:35,340 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:35,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:35,341 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:35,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:35,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:35,344 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:06:35,344 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:06:35,344 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:06:35,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:06:35,344 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:06:35,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:06:35,344 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:06:35,345 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:35,345 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:06:35,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:06:35,345 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:06:35,344 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:06:35,345 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:06:35,345 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-23 10:06:35,346 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:35,345 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:06:35,346 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:35,347 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:06:35,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:06:35,345 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:06:35,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:06:35,345 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-23 10:06:35,347 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-23 10:06:35,347 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-23 10:06:35,347 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:06:35,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:06:35,347 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:35,347 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-23 10:06:35,347 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 10:06:35,347 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-23 10:06:35,347 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:35,347 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:35,347 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 10:06:35,348 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 10:06:35,348 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202307231f6e054ba8454caa8dd145bf73d4da9b, hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202307237fe8bb6de276435ebf5a3d1437dac242] mob files 2023-07-23 10:06:35,349 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202307231f6e054ba8454caa8dd145bf73d4da9b 2023-07-23 10:06:35,349 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202307237fe8bb6de276435ebf5a3d1437dac242 2023-07-23 10:06:35,360 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-23 10:06:35,361 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-23 10:06:35,385 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-23 10:06:35,415 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-23 10:06:35,415 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-23 10:06:35,416 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-23 10:06:35,416 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1690106795182Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1690106795360 (+178 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1690106795360Loading Region manifests for snaptb0-testExportFileSystemState at 1690106795360Writing data manifest for snaptb0-testExportFileSystemState at 1690106795367 (+7 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1690106795376 (+9 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1690106795415 (+39 ms) 2023-07-23 10:06:35,419 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-23 10:06:35,424 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 236 msec 2023-07-23 10:06:35,486 DEBUG [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 10:06:35,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-23 10:06:35,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-23 10:06:35,487 INFO [Listener at jenkins-hbase4.apache.org/44565] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/export-test/export-1690106795487 2023-07-23 10:06:35,487 INFO [Listener at jenkins-hbase4.apache.org/44565] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:37479, tgtDir=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/export-test/export-1690106795487, rawTgtDir=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/export-test/export-1690106795487, srcFsUri=hdfs://localhost:37479, srcDir=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528 2023-07-23 10:06:35,515 DEBUG [Listener at jenkins-hbase4.apache.org/44565] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:37479, inputRoot=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528 2023-07-23 10:06:35,516 DEBUG [Listener at jenkins-hbase4.apache.org/44565] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1733696251_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/export-test/export-1690106795487, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/export-test/export-1690106795487/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-23 10:06:35,516 INFO [Listener at jenkins-hbase4.apache.org/44565] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:37479, inputRoot=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528, snapshotDir=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-23 10:06:35,533 INFO [Listener at jenkins-hbase4.apache.org/44565] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/export-test/export-1690106795487/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-23 10:06:35,566 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-23 10:06:35,567 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-23 10:06:35,567 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-23 10:06:35,568 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-23 10:06:35,568 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-23 10:06:35,568 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-23 10:06:35,569 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-23 10:06:35,638 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f0c2d64d-3350-bc69-1c38-d6964a44400f/hadoop-438108189017082905.jar 2023-07-23 10:06:35,639 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-23 10:06:35,640 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-23 10:06:35,640 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-23 10:06:35,640 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-23 10:06:35,641 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-23 10:06:35,641 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-23 10:06:35,641 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-23 10:06:35,642 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-23 10:06:35,642 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-23 10:06:35,643 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-23 10:06:35,643 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-23 10:06:35,644 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-23 10:06:35,645 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-23 10:06:35,645 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-23 10:06:35,645 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-23 10:06:35,646 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-23 10:06:35,647 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 10:06:35,647 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 10:06:35,648 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 10:06:35,648 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 10:06:35,649 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 10:06:35,649 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 10:06:35,650 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 10:06:36,082 WARN [Listener at jenkins-hbase4.apache.org/44565] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-23 10:06:36,085 INFO [Listener at jenkins-hbase4.apache.org/44565] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-23 10:06:36,087 DEBUG [Listener at jenkins-hbase4.apache.org/44565] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-23 10:06:38,239 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 10:06:38,240 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 10:06:38,246 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690106775176_0001_000001 (auth:SIMPLE) 2023-07-23 10:06:38,959 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690106775176_0002_000001 (auth:SIMPLE) 2023-07-23 10:06:39,256 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-23 10:06:43,334 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690106775176_0002_000001 (auth:SIMPLE) 2023-07-23 10:06:45,602 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690106775176_0002_000001 (auth:SIMPLE) 2023-07-23 10:06:48,477 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690106775176_0002_000001 (auth:SIMPLE) 2023-07-23 10:06:50,342 INFO [Listener at jenkins-hbase4.apache.org/44565] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-23 10:06:50,343 INFO [Listener at jenkins-hbase4.apache.org/44565] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-23 10:06:50,353 INFO [Listener at jenkins-hbase4.apache.org/44565] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-23 10:06:50,353 INFO [Listener at jenkins-hbase4.apache.org/44565] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-23 10:06:50,354 INFO [Listener at jenkins-hbase4.apache.org/44565] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-23 10:06:50,355 DEBUG [Listener at jenkins-hbase4.apache.org/44565] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-165846724_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-23 10:06:50,355 DEBUG [Listener at jenkins-hbase4.apache.org/44565] snapshot.TestExportSnapshot(367): hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-23 10:06:50,355 DEBUG [Listener at jenkins-hbase4.apache.org/44565] snapshot.TestExportSnapshot(367): hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-23 10:06:50,355 DEBUG [Listener at jenkins-hbase4.apache.org/44565] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-165846724_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/export-test/export-1690106795487/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/export-test/export-1690106795487/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-23 10:06:50,356 DEBUG [Listener at jenkins-hbase4.apache.org/44565] snapshot.TestExportSnapshot(367): hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/export-test/export-1690106795487/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-23 10:06:50,356 DEBUG [Listener at jenkins-hbase4.apache.org/44565] snapshot.TestExportSnapshot(367): hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/export-test/export-1690106795487/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-23 10:06:50,364 INFO [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-23 10:06:50,365 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-07-23 10:06:50,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-23 10:06:50,376 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690106810376"}]},"ts":"1690106810376"} 2023-07-23 10:06:50,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-23 10:06:50,378 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-23 10:06:50,380 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-23 10:06:50,381 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=433b5c9da757baa1b99f953417ba4e80, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=2b2ead90d115ba361ac7bdc982c18bbd, UNASSIGN}] 2023-07-23 10:06:50,383 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=433b5c9da757baa1b99f953417ba4e80, UNASSIGN 2023-07-23 10:06:50,384 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=2b2ead90d115ba361ac7bdc982c18bbd, UNASSIGN 2023-07-23 10:06:50,384 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=433b5c9da757baa1b99f953417ba4e80, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:50,385 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1690106794138.433b5c9da757baa1b99f953417ba4e80.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690106810384"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690106810384"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690106810384"}]},"ts":"1690106810384"} 2023-07-23 10:06:50,385 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=2b2ead90d115ba361ac7bdc982c18bbd, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:50,385 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1690106794138.2b2ead90d115ba361ac7bdc982c18bbd.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690106810385"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690106810385"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690106810385"}]},"ts":"1690106810385"} 2023-07-23 10:06:50,386 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure 433b5c9da757baa1b99f953417ba4e80, server=jenkins-hbase4.apache.org,36599,1690106767729}] 2023-07-23 10:06:50,387 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure 2b2ead90d115ba361ac7bdc982c18bbd, server=jenkins-hbase4.apache.org,36827,1690106767853}] 2023-07-23 10:06:50,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-23 10:06:50,540 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 433b5c9da757baa1b99f953417ba4e80 2023-07-23 10:06:50,540 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 2b2ead90d115ba361ac7bdc982c18bbd 2023-07-23 10:06:50,540 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 433b5c9da757baa1b99f953417ba4e80, disabling compactions & flushes 2023-07-23 10:06:50,540 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2b2ead90d115ba361ac7bdc982c18bbd, disabling compactions & flushes 2023-07-23 10:06:50,540 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1690106794138.433b5c9da757baa1b99f953417ba4e80. 2023-07-23 10:06:50,540 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1690106794138.2b2ead90d115ba361ac7bdc982c18bbd. 2023-07-23 10:06:50,540 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1690106794138.433b5c9da757baa1b99f953417ba4e80. 2023-07-23 10:06:50,541 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1690106794138.2b2ead90d115ba361ac7bdc982c18bbd. 2023-07-23 10:06:50,541 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1690106794138.433b5c9da757baa1b99f953417ba4e80. after waiting 0 ms 2023-07-23 10:06:50,541 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1690106794138.2b2ead90d115ba361ac7bdc982c18bbd. after waiting 0 ms 2023-07-23 10:06:50,541 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1690106794138.433b5c9da757baa1b99f953417ba4e80. 2023-07-23 10:06:50,541 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1690106794138.2b2ead90d115ba361ac7bdc982c18bbd. 2023-07-23 10:06:50,564 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemState/2b2ead90d115ba361ac7bdc982c18bbd/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-23 10:06:50,564 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemState/433b5c9da757baa1b99f953417ba4e80/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-23 10:06:50,565 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 10:06:50,565 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 10:06:50,565 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1690106794138.2b2ead90d115ba361ac7bdc982c18bbd. 2023-07-23 10:06:50,566 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2b2ead90d115ba361ac7bdc982c18bbd: 2023-07-23 10:06:50,566 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1690106794138.433b5c9da757baa1b99f953417ba4e80. 2023-07-23 10:06:50,566 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 433b5c9da757baa1b99f953417ba4e80: 2023-07-23 10:06:50,568 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 2b2ead90d115ba361ac7bdc982c18bbd 2023-07-23 10:06:50,569 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=2b2ead90d115ba361ac7bdc982c18bbd, regionState=CLOSED 2023-07-23 10:06:50,569 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 433b5c9da757baa1b99f953417ba4e80 2023-07-23 10:06:50,569 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1690106794138.2b2ead90d115ba361ac7bdc982c18bbd.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690106810569"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690106810569"}]},"ts":"1690106810569"} 2023-07-23 10:06:50,570 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=433b5c9da757baa1b99f953417ba4e80, regionState=CLOSED 2023-07-23 10:06:50,570 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1690106794138.433b5c9da757baa1b99f953417ba4e80.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690106810570"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690106810570"}]},"ts":"1690106810570"} 2023-07-23 10:06:50,582 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=38 2023-07-23 10:06:50,583 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=37 2023-07-23 10:06:50,583 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure 2b2ead90d115ba361ac7bdc982c18bbd, server=jenkins-hbase4.apache.org,36827,1690106767853 in 184 msec 2023-07-23 10:06:50,583 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure 433b5c9da757baa1b99f953417ba4e80, server=jenkins-hbase4.apache.org,36599,1690106767729 in 186 msec 2023-07-23 10:06:50,584 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=433b5c9da757baa1b99f953417ba4e80, UNASSIGN in 202 msec 2023-07-23 10:06:50,585 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=38, resume processing ppid=36 2023-07-23 10:06:50,585 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=2b2ead90d115ba361ac7bdc982c18bbd, UNASSIGN in 202 msec 2023-07-23 10:06:50,586 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690106810586"}]},"ts":"1690106810586"} 2023-07-23 10:06:50,587 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-23 10:06:50,589 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-23 10:06:50,591 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 225 msec 2023-07-23 10:06:50,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-23 10:06:50,681 INFO [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-23 10:06:50,681 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-07-23 10:06:50,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-23 10:06:50,686 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-23 10:06:50,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-23 10:06:50,686 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-23 10:06:50,688 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39563] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-23 10:06:50,692 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportFileSystemState/433b5c9da757baa1b99f953417ba4e80 2023-07-23 10:06:50,692 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportFileSystemState/2b2ead90d115ba361ac7bdc982c18bbd 2023-07-23 10:06:50,692 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-23 10:06:50,692 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-23 10:06:50,692 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-23 10:06:50,692 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-23 10:06:50,693 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-23 10:06:50,693 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-23 10:06:50,693 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-23 10:06:50,693 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-23 10:06:50,694 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-23 10:06:50,694 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:06:50,694 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-23 10:06:50,694 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-23 10:06:50,694 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-23 10:06:50,694 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:06:50,694 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:06:50,694 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:06:50,694 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportFileSystemState/433b5c9da757baa1b99f953417ba4e80/cf, FileablePath, hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportFileSystemState/433b5c9da757baa1b99f953417ba4e80/recovered.edits] 2023-07-23 10:06:50,695 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportFileSystemState/2b2ead90d115ba361ac7bdc982c18bbd/cf, FileablePath, hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportFileSystemState/2b2ead90d115ba361ac7bdc982c18bbd/recovered.edits] 2023-07-23 10:06:50,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-23 10:06:50,699 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportFileSystemState/433b5c9da757baa1b99f953417ba4e80/cf/a59611269c29401290f82222262c5b7e to hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/archive/data/default/testtb-testExportFileSystemState/433b5c9da757baa1b99f953417ba4e80/cf/a59611269c29401290f82222262c5b7e 2023-07-23 10:06:50,699 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportFileSystemState/2b2ead90d115ba361ac7bdc982c18bbd/cf/54b36d93ca714f46b12c2e6d3445e45a to hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/archive/data/default/testtb-testExportFileSystemState/2b2ead90d115ba361ac7bdc982c18bbd/cf/54b36d93ca714f46b12c2e6d3445e45a 2023-07-23 10:06:50,702 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportFileSystemState/433b5c9da757baa1b99f953417ba4e80/recovered.edits/9.seqid to hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/archive/data/default/testtb-testExportFileSystemState/433b5c9da757baa1b99f953417ba4e80/recovered.edits/9.seqid 2023-07-23 10:06:50,703 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportFileSystemState/2b2ead90d115ba361ac7bdc982c18bbd/recovered.edits/9.seqid to hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/archive/data/default/testtb-testExportFileSystemState/2b2ead90d115ba361ac7bdc982c18bbd/recovered.edits/9.seqid 2023-07-23 10:06:50,703 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportFileSystemState/433b5c9da757baa1b99f953417ba4e80 2023-07-23 10:06:50,703 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportFileSystemState/2b2ead90d115ba361ac7bdc982c18bbd 2023-07-23 10:06:50,703 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-23 10:06:50,704 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-23 10:06:50,705 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-07-23 10:06:50,708 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202307231f6e054ba8454caa8dd145bf73d4da9b to hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202307231f6e054ba8454caa8dd145bf73d4da9b 2023-07-23 10:06:50,710 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202307237fe8bb6de276435ebf5a3d1437dac242 to hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202307237fe8bb6de276435ebf5a3d1437dac242 2023-07-23 10:06:50,710 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-23 10:06:50,713 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-23 10:06:50,715 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-23 10:06:50,717 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-23 10:06:50,718 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-23 10:06:50,718 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-23 10:06:50,719 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1690106794138.433b5c9da757baa1b99f953417ba4e80.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690106810719"}]},"ts":"9223372036854775807"} 2023-07-23 10:06:50,719 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1690106794138.2b2ead90d115ba361ac7bdc982c18bbd.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690106810719"}]},"ts":"9223372036854775807"} 2023-07-23 10:06:50,720 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-23 10:06:50,721 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 433b5c9da757baa1b99f953417ba4e80, NAME => 'testtb-testExportFileSystemState,,1690106794138.433b5c9da757baa1b99f953417ba4e80.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 2b2ead90d115ba361ac7bdc982c18bbd, NAME => 'testtb-testExportFileSystemState,1,1690106794138.2b2ead90d115ba361ac7bdc982c18bbd.', STARTKEY => '1', ENDKEY => ''}] 2023-07-23 10:06:50,721 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-23 10:06:50,721 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690106810721"}]},"ts":"9223372036854775807"} 2023-07-23 10:06:50,722 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-23 10:06:50,724 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-23 10:06:50,726 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 43 msec 2023-07-23 10:06:50,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-23 10:06:50,797 INFO [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-23 10:06:50,804 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-23 10:06:50,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-23 10:06:50,808 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-07-23 10:06:50,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-23 10:06:50,834 INFO [Listener at jenkins-hbase4.apache.org/44565] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=762 (was 752) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_545051608_1 at /127.0.0.1:54644 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-165846724_17 at /127.0.0.1:42398 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1575588394) connection to jenkins-hbase4.apache.org/172.31.14.131:40503 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Thread-2026 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3cfc6090-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3cfc6090-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3cfc6090-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3cfc6090-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-165846724_17 at /127.0.0.1:34088 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-165846724_17 at /127.0.0.1:42446 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=922 (was 920) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=283 (was 260) - SystemLoadAverage LEAK? -, ProcessCount=179 (was 182), AvailableMemoryMB=6454 (was 6619) 2023-07-23 10:06:50,835 WARN [Listener at jenkins-hbase4.apache.org/44565] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-23 10:06:50,854 INFO [Listener at jenkins-hbase4.apache.org/44565] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=762, OpenFileDescriptor=922, MaxFileDescriptor=60000, SystemLoadAverage=283, ProcessCount=179, AvailableMemoryMB=6453 2023-07-23 10:06:50,854 WARN [Listener at jenkins-hbase4.apache.org/44565] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-23 10:06:50,855 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-23 10:06:50,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-23 10:06:50,858 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-23 10:06:50,859 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-23 10:06:50,860 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-23 10:06:50,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-23 10:06:50,862 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testConsecutiveExports/3e08df92b9aac5347059674256892a79 2023-07-23 10:06:50,862 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testConsecutiveExports/0de37c8a326acd4b5160339a10a464bb 2023-07-23 10:06:50,863 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testConsecutiveExports/3e08df92b9aac5347059674256892a79 empty. 2023-07-23 10:06:50,863 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testConsecutiveExports/0de37c8a326acd4b5160339a10a464bb empty. 2023-07-23 10:06:50,863 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testConsecutiveExports/3e08df92b9aac5347059674256892a79 2023-07-23 10:06:50,863 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testConsecutiveExports/0de37c8a326acd4b5160339a10a464bb 2023-07-23 10:06:50,863 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-23 10:06:50,873 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-23 10:06:50,875 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 3e08df92b9aac5347059674256892a79, NAME => 'testtb-testConsecutiveExports,,1690106810855.3e08df92b9aac5347059674256892a79.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp 2023-07-23 10:06:50,875 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 0de37c8a326acd4b5160339a10a464bb, NAME => 'testtb-testConsecutiveExports,1,1690106810855.0de37c8a326acd4b5160339a10a464bb.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp 2023-07-23 10:06:50,883 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1690106810855.3e08df92b9aac5347059674256892a79.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 10:06:50,883 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 3e08df92b9aac5347059674256892a79, disabling compactions & flushes 2023-07-23 10:06:50,883 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1690106810855.0de37c8a326acd4b5160339a10a464bb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 10:06:50,883 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1690106810855.3e08df92b9aac5347059674256892a79. 2023-07-23 10:06:50,883 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 0de37c8a326acd4b5160339a10a464bb, disabling compactions & flushes 2023-07-23 10:06:50,883 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1690106810855.3e08df92b9aac5347059674256892a79. 2023-07-23 10:06:50,883 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1690106810855.0de37c8a326acd4b5160339a10a464bb. 2023-07-23 10:06:50,883 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1690106810855.3e08df92b9aac5347059674256892a79. after waiting 0 ms 2023-07-23 10:06:50,883 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1690106810855.0de37c8a326acd4b5160339a10a464bb. 2023-07-23 10:06:50,883 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1690106810855.3e08df92b9aac5347059674256892a79. 2023-07-23 10:06:50,884 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1690106810855.0de37c8a326acd4b5160339a10a464bb. after waiting 0 ms 2023-07-23 10:06:50,884 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1690106810855.3e08df92b9aac5347059674256892a79. 2023-07-23 10:06:50,884 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1690106810855.0de37c8a326acd4b5160339a10a464bb. 2023-07-23 10:06:50,884 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 3e08df92b9aac5347059674256892a79: 2023-07-23 10:06:50,884 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1690106810855.0de37c8a326acd4b5160339a10a464bb. 2023-07-23 10:06:50,884 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 0de37c8a326acd4b5160339a10a464bb: 2023-07-23 10:06:50,886 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-23 10:06:50,887 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1690106810855.3e08df92b9aac5347059674256892a79.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690106810887"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690106810887"}]},"ts":"1690106810887"} 2023-07-23 10:06:50,887 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1690106810855.0de37c8a326acd4b5160339a10a464bb.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690106810887"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690106810887"}]},"ts":"1690106810887"} 2023-07-23 10:06:50,889 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-23 10:06:50,890 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-23 10:06:50,890 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690106810890"}]},"ts":"1690106810890"} 2023-07-23 10:06:50,892 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-23 10:06:50,897 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-23 10:06:50,898 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-23 10:06:50,898 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-23 10:06:50,898 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-23 10:06:50,898 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-23 10:06:50,898 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=3e08df92b9aac5347059674256892a79, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0de37c8a326acd4b5160339a10a464bb, ASSIGN}] 2023-07-23 10:06:50,901 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0de37c8a326acd4b5160339a10a464bb, ASSIGN 2023-07-23 10:06:50,901 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=3e08df92b9aac5347059674256892a79, ASSIGN 2023-07-23 10:06:50,902 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0de37c8a326acd4b5160339a10a464bb, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39563,1690106767800; forceNewPlan=false, retain=false 2023-07-23 10:06:50,902 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=3e08df92b9aac5347059674256892a79, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36827,1690106767853; forceNewPlan=false, retain=false 2023-07-23 10:06:50,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-23 10:06:51,052 INFO [jenkins-hbase4:34097] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-23 10:06:51,055 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=3e08df92b9aac5347059674256892a79, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:51,055 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=0de37c8a326acd4b5160339a10a464bb, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:51,055 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1690106810855.3e08df92b9aac5347059674256892a79.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690106811055"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690106811055"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690106811055"}]},"ts":"1690106811055"} 2023-07-23 10:06:51,055 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1690106810855.0de37c8a326acd4b5160339a10a464bb.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690106811055"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690106811055"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690106811055"}]},"ts":"1690106811055"} 2023-07-23 10:06:51,057 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; OpenRegionProcedure 3e08df92b9aac5347059674256892a79, server=jenkins-hbase4.apache.org,36827,1690106767853}] 2023-07-23 10:06:51,058 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=44, state=RUNNABLE; OpenRegionProcedure 0de37c8a326acd4b5160339a10a464bb, server=jenkins-hbase4.apache.org,39563,1690106767800}] 2023-07-23 10:06:51,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-23 10:06:51,212 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1690106810855.3e08df92b9aac5347059674256892a79. 2023-07-23 10:06:51,212 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3e08df92b9aac5347059674256892a79, NAME => 'testtb-testConsecutiveExports,,1690106810855.3e08df92b9aac5347059674256892a79.', STARTKEY => '', ENDKEY => '1'} 2023-07-23 10:06:51,213 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1690106810855.3e08df92b9aac5347059674256892a79. service=AccessControlService 2023-07-23 10:06:51,213 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 10:06:51,213 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 3e08df92b9aac5347059674256892a79 2023-07-23 10:06:51,213 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1690106810855.3e08df92b9aac5347059674256892a79.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 10:06:51,213 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 3e08df92b9aac5347059674256892a79 2023-07-23 10:06:51,213 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 3e08df92b9aac5347059674256892a79 2023-07-23 10:06:51,218 INFO [StoreOpener-3e08df92b9aac5347059674256892a79-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 3e08df92b9aac5347059674256892a79 2023-07-23 10:06:51,219 DEBUG [StoreOpener-3e08df92b9aac5347059674256892a79-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testConsecutiveExports/3e08df92b9aac5347059674256892a79/cf 2023-07-23 10:06:51,219 DEBUG [StoreOpener-3e08df92b9aac5347059674256892a79-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testConsecutiveExports/3e08df92b9aac5347059674256892a79/cf 2023-07-23 10:06:51,220 INFO [StoreOpener-3e08df92b9aac5347059674256892a79-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3e08df92b9aac5347059674256892a79 columnFamilyName cf 2023-07-23 10:06:51,220 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1690106810855.0de37c8a326acd4b5160339a10a464bb. 2023-07-23 10:06:51,220 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0de37c8a326acd4b5160339a10a464bb, NAME => 'testtb-testConsecutiveExports,1,1690106810855.0de37c8a326acd4b5160339a10a464bb.', STARTKEY => '1', ENDKEY => ''} 2023-07-23 10:06:51,221 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1690106810855.0de37c8a326acd4b5160339a10a464bb. service=AccessControlService 2023-07-23 10:06:51,221 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 10:06:51,221 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 0de37c8a326acd4b5160339a10a464bb 2023-07-23 10:06:51,221 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1690106810855.0de37c8a326acd4b5160339a10a464bb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 10:06:51,221 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0de37c8a326acd4b5160339a10a464bb 2023-07-23 10:06:51,221 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0de37c8a326acd4b5160339a10a464bb 2023-07-23 10:06:51,222 INFO [StoreOpener-3e08df92b9aac5347059674256892a79-1] regionserver.HStore(310): Store=3e08df92b9aac5347059674256892a79/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 10:06:51,223 INFO [StoreOpener-0de37c8a326acd4b5160339a10a464bb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0de37c8a326acd4b5160339a10a464bb 2023-07-23 10:06:51,223 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testConsecutiveExports/3e08df92b9aac5347059674256892a79 2023-07-23 10:06:51,223 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testConsecutiveExports/3e08df92b9aac5347059674256892a79 2023-07-23 10:06:51,224 DEBUG [StoreOpener-0de37c8a326acd4b5160339a10a464bb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testConsecutiveExports/0de37c8a326acd4b5160339a10a464bb/cf 2023-07-23 10:06:51,224 DEBUG [StoreOpener-0de37c8a326acd4b5160339a10a464bb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testConsecutiveExports/0de37c8a326acd4b5160339a10a464bb/cf 2023-07-23 10:06:51,225 INFO [StoreOpener-0de37c8a326acd4b5160339a10a464bb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0de37c8a326acd4b5160339a10a464bb columnFamilyName cf 2023-07-23 10:06:51,226 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 3e08df92b9aac5347059674256892a79 2023-07-23 10:06:51,226 INFO [StoreOpener-0de37c8a326acd4b5160339a10a464bb-1] regionserver.HStore(310): Store=0de37c8a326acd4b5160339a10a464bb/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 10:06:51,227 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testConsecutiveExports/0de37c8a326acd4b5160339a10a464bb 2023-07-23 10:06:51,228 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testConsecutiveExports/0de37c8a326acd4b5160339a10a464bb 2023-07-23 10:06:51,228 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testConsecutiveExports/3e08df92b9aac5347059674256892a79/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 10:06:51,231 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 3e08df92b9aac5347059674256892a79; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59384560, jitterRate=-0.11510109901428223}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 10:06:51,231 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 3e08df92b9aac5347059674256892a79: 2023-07-23 10:06:51,232 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0de37c8a326acd4b5160339a10a464bb 2023-07-23 10:06:51,234 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1690106810855.3e08df92b9aac5347059674256892a79., pid=45, masterSystemTime=1690106811209 2023-07-23 10:06:51,234 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testConsecutiveExports/0de37c8a326acd4b5160339a10a464bb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 10:06:51,235 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0de37c8a326acd4b5160339a10a464bb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72588924, jitterRate=0.08165925741195679}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 10:06:51,235 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0de37c8a326acd4b5160339a10a464bb: 2023-07-23 10:06:51,236 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1690106810855.3e08df92b9aac5347059674256892a79. 2023-07-23 10:06:51,236 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1690106810855.3e08df92b9aac5347059674256892a79. 2023-07-23 10:06:51,236 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1690106810855.0de37c8a326acd4b5160339a10a464bb., pid=46, masterSystemTime=1690106811213 2023-07-23 10:06:51,236 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=3e08df92b9aac5347059674256892a79, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:51,236 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1690106810855.3e08df92b9aac5347059674256892a79.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690106811236"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690106811236"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690106811236"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690106811236"}]},"ts":"1690106811236"} 2023-07-23 10:06:51,238 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1690106810855.0de37c8a326acd4b5160339a10a464bb. 2023-07-23 10:06:51,238 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1690106810855.0de37c8a326acd4b5160339a10a464bb. 2023-07-23 10:06:51,238 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=0de37c8a326acd4b5160339a10a464bb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:51,238 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1690106810855.0de37c8a326acd4b5160339a10a464bb.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690106811238"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690106811238"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690106811238"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690106811238"}]},"ts":"1690106811238"} 2023-07-23 10:06:51,240 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=43 2023-07-23 10:06:51,241 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=43, state=SUCCESS; OpenRegionProcedure 3e08df92b9aac5347059674256892a79, server=jenkins-hbase4.apache.org,36827,1690106767853 in 181 msec 2023-07-23 10:06:51,242 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=3e08df92b9aac5347059674256892a79, ASSIGN in 342 msec 2023-07-23 10:06:51,243 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=44 2023-07-23 10:06:51,243 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=44, state=SUCCESS; OpenRegionProcedure 0de37c8a326acd4b5160339a10a464bb, server=jenkins-hbase4.apache.org,39563,1690106767800 in 182 msec 2023-07-23 10:06:51,245 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=42 2023-07-23 10:06:51,245 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0de37c8a326acd4b5160339a10a464bb, ASSIGN in 345 msec 2023-07-23 10:06:51,246 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-23 10:06:51,246 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690106811246"}]},"ts":"1690106811246"} 2023-07-23 10:06:51,248 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-23 10:06:51,251 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-23 10:06:51,251 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-23 10:06:51,253 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39563] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-23 10:06:51,255 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:06:51,255 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:06:51,255 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:06:51,255 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:06:51,257 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-23 10:06:51,258 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-23 10:06:51,258 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-23 10:06:51,258 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-23 10:06:51,260 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 403 msec 2023-07-23 10:06:51,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-23 10:06:51,463 INFO [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-23 10:06:51,466 DEBUG [Listener at jenkins-hbase4.apache.org/44565] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-23 10:06:51,466 DEBUG [Listener at jenkins-hbase4.apache.org/44565] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1690106810855.3e08df92b9aac5347059674256892a79. 2023-07-23 10:06:51,468 INFO [Listener at jenkins-hbase4.apache.org/44565] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 10:06:51,480 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-23 10:06:51,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690106811480 (current time:1690106811480). 2023-07-23 10:06:51,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-23 10:06:51,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] zookeeper.ReadOnlyZKClient(139): Connect 0x75f01017 to 127.0.0.1:55181 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 10:06:51,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1dd3b4b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 10:06:51,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 10:06:51,494 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46482, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 10:06:51,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x75f01017 to 127.0.0.1:55181 2023-07-23 10:06:51,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 10:06:51,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] zookeeper.ReadOnlyZKClient(139): Connect 0x1137b926 to 127.0.0.1:55181 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 10:06:51,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@643263bf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 10:06:51,502 DEBUG [hconnection-0xc5d0b11-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 10:06:51,504 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46484, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 10:06:51,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1137b926 to 127.0.0.1:55181 2023-07-23 10:06:51,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 10:06:51,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-23 10:06:51,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-23 10:06:51,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-23 10:06:51,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-23 10:06:51,512 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-23 10:06:51,513 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1690107411513 2023-07-23 10:06:51,513 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-23 10:06:51,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-23 10:06:51,515 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-23 10:06:51,516 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-23 10:06:51,517 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 6 msec 2023-07-23 10:06:51,517 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-23 10:06:51,518 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1690107411518 2023-07-23 10:06:51,518 DEBUG [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-23 10:06:51,519 DEBUG [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-23 10:06:51,534 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:51,534 INFO [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-23 10:06:51,535 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:06:51,536 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-23 10:06:51,536 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-23 10:06:51,536 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:51,536 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:51,539 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:06:51,539 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:06:51,539 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:06:51,539 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:06:51,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:06:51,539 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:51,539 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:06:51,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:06:51,539 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:06:51,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:06:51,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:51,539 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:51,540 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:51,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:51,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:51,540 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:51,540 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:51,540 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-23 10:06:51,540 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:51,540 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:51,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-23 10:06:51,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:51,540 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-23 10:06:51,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-23 10:06:51,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:51,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-23 10:06:51,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:51,541 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-23 10:06:51,541 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:51,541 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-23 10:06:51,541 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-23 10:06:51,541 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:51,541 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:06:51,541 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-23 10:06:51,542 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-23 10:06:51,542 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:06:51,542 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-23 10:06:51,543 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-23 10:06:51,543 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-23 10:06:51,541 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:51,543 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36827,1690106767853' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-23 10:06:51,543 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36599,1690106767729' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-23 10:06:51,543 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-23 10:06:51,543 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:06:51,546 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-23 10:06:51,546 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-23 10:06:51,546 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39563,1690106767800' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-23 10:06:51,548 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:51,549 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:51,549 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:51,549 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:51,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:51,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:06:51,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:06:51,549 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:51,549 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 10:06:51,549 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:51,549 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:51,549 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 10:06:51,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:06:51,549 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:51,549 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 10:06:51,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:06:51,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:51,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:51,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:51,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:51,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:06:51,551 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36827,1690106767853' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-23 10:06:51,551 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@253a3cbf[Count = 1] remaining members to acquire global barrier 2023-07-23 10:06:51,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:51,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:06:51,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:06:51,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:06:51,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:06:51,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:51,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:51,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:51,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:51,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:06:51,553 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39563,1690106767800' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-23 10:06:51,553 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@253a3cbf[Count = 0] remaining members to acquire global barrier 2023-07-23 10:06:51,553 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-23 10:06:51,553 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:51,555 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:51,555 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:51,555 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:51,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:51,555 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:51,555 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-23 10:06:51,555 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:51,555 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:51,555 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 10:06:51,555 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 10:06:51,555 DEBUG [rs(jenkins-hbase4.apache.org,39563,1690106767800)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1690106810855.0de37c8a326acd4b5160339a10a464bb. 2023-07-23 10:06:51,555 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:51,555 DEBUG [rs(jenkins-hbase4.apache.org,39563,1690106767800)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1690106810855.0de37c8a326acd4b5160339a10a464bb. started... 2023-07-23 10:06:51,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:51,555 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:51,555 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-23 10:06:51,555 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-23 10:06:51,556 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,36599,1690106767729' in zk 2023-07-23 10:06:51,556 DEBUG [rs(jenkins-hbase4.apache.org,39563,1690106767800)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0de37c8a326acd4b5160339a10a464bb: 2023-07-23 10:06:51,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:51,555 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-23 10:06:51,556 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-23 10:06:51,556 DEBUG [rs(jenkins-hbase4.apache.org,39563,1690106767800)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1690106810855.0de37c8a326acd4b5160339a10a464bb.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:51,557 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 10:06:51,557 DEBUG [rs(jenkins-hbase4.apache.org,39563,1690106767800)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 10:06:51,557 DEBUG [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1690106810855.3e08df92b9aac5347059674256892a79. 2023-07-23 10:06:51,557 DEBUG [rs(jenkins-hbase4.apache.org,39563,1690106767800)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-23 10:06:51,557 DEBUG [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1690106810855.3e08df92b9aac5347059674256892a79. started... 2023-07-23 10:06:51,557 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 10:06:51,557 DEBUG [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3e08df92b9aac5347059674256892a79: 2023-07-23 10:06:51,558 DEBUG [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1690106810855.3e08df92b9aac5347059674256892a79.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:51,558 DEBUG [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 10:06:51,558 DEBUG [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-23 10:06:51,567 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-23 10:06:51,567 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:06:51,567 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-23 10:06:51,574 DEBUG [rs(jenkins-hbase4.apache.org,39563,1690106767800)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1690106810855.0de37c8a326acd4b5160339a10a464bb. completed. 2023-07-23 10:06:51,574 DEBUG [rs(jenkins-hbase4.apache.org,39563,1690106767800)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1690106810855.0de37c8a326acd4b5160339a10a464bb. 2023-07-23 10:06:51,574 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 10:06:51,575 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 10:06:51,575 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:51,575 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-23 10:06:51,575 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,39563,1690106767800' in zk 2023-07-23 10:06:51,575 DEBUG [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1690106810855.3e08df92b9aac5347059674256892a79. completed. 2023-07-23 10:06:51,575 DEBUG [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1690106810855.3e08df92b9aac5347059674256892a79. 2023-07-23 10:06:51,575 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 10:06:51,575 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 10:06:51,575 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:51,575 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-23 10:06:51,575 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,36827,1690106767853' in zk 2023-07-23 10:06:51,577 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-23 10:06:51,577 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:51,577 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:06:51,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:51,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:06:51,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:06:51,577 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-23 10:06:51,579 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:51,579 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-23 10:06:51,579 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:06:51,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:06:51,579 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-23 10:06:51,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:06:51,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:51,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:51,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:51,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:51,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:06:51,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:51,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:51,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:51,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:51,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,39563,1690106767800': 2023-07-23 10:06:51,583 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39563,1690106767800' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-23 10:06:51,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:51,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:06:51,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:06:51,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:06:51,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:06:51,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:51,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:51,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:51,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:51,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:06:51,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:51,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:51,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:51,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:51,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,36827,1690106767853': 2023-07-23 10:06:51,586 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36827,1690106767853' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-23 10:06:51,586 INFO [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-23 10:06:51,586 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-23 10:06:51,586 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-23 10:06:51,586 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:51,586 INFO [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-23 10:06:51,589 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:51,589 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:51,589 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:06:51,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:51,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:06:51,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:06:51,589 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:51,589 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:51,589 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:51,589 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:51,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:51,589 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:06:51,589 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:51,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:06:51,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:51,589 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:06:51,589 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:51,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:51,590 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:06:51,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:51,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:06:51,590 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:06:51,590 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:06:51,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:06:51,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:06:51,590 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:51,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:51,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:06:51,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:51,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:51,591 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:51,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:51,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:51,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:51,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:51,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:06:51,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:51,593 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:51,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:51,593 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:51,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:51,593 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:51,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:51,596 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:51,596 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:51,596 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:51,596 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:51,596 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:06:51,596 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:51,596 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:06:51,596 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:06:51,596 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:06:51,596 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:06:51,596 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:51,596 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:51,596 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:06:51,597 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:51,597 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-23 10:06:51,596 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:06:51,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:06:51,596 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:06:51,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:06:51,597 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:51,597 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:51,599 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-23 10:06:51,597 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:06:51,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:06:51,597 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:06:51,599 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:06:51,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:06:51,599 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:51,599 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:06:51,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:06:51,599 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:51,599 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:06:51,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:06:51,599 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:51,600 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-23 10:06:51,610 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:51,611 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:51,619 DEBUG [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 10:06:51,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-23 10:06:51,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-23 10:06:51,620 DEBUG [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-23 10:06:51,634 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:51,654 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-23 10:06:51,655 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:51,655 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-23 10:06:51,655 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1690106811513Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1690106811610 (+97 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1690106811610Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1690106811610Writing data manifest for emptySnaptb0-testConsecutiveExports at 1690106811615 (+5 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1690106811628 (+13 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1690106811654 (+26 ms) 2023-07-23 10:06:51,660 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-23 10:06:51,661 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 146 msec 2023-07-23 10:06:51,820 DEBUG [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 10:06:51,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-23 10:06:51,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-23 10:06:51,825 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36827] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1690106810855.3e08df92b9aac5347059674256892a79. with WAL disabled. Data may be lost in the event of a crash. 2023-07-23 10:06:51,826 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39563] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1690106810855.0de37c8a326acd4b5160339a10a464bb. with WAL disabled. Data may be lost in the event of a crash. 2023-07-23 10:06:51,830 DEBUG [Listener at jenkins-hbase4.apache.org/44565] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-23 10:06:51,830 DEBUG [Listener at jenkins-hbase4.apache.org/44565] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1690106810855.3e08df92b9aac5347059674256892a79. 2023-07-23 10:06:51,830 INFO [Listener at jenkins-hbase4.apache.org/44565] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 10:06:51,844 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-23 10:06:51,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690106811844 (current time:1690106811844). 2023-07-23 10:06:51,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-23 10:06:51,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] zookeeper.ReadOnlyZKClient(139): Connect 0x2559d24d to 127.0.0.1:55181 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 10:06:51,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7d0540d2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 10:06:51,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 10:06:51,862 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46496, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 10:06:51,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2559d24d to 127.0.0.1:55181 2023-07-23 10:06:51,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 10:06:51,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] zookeeper.ReadOnlyZKClient(139): Connect 0x151ee48b to 127.0.0.1:55181 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 10:06:51,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7ebe97df, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 10:06:51,872 DEBUG [hconnection-0x296a4b0a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 10:06:51,873 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46510, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 10:06:51,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x151ee48b to 127.0.0.1:55181 2023-07-23 10:06:51,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 10:06:51,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-23 10:06:51,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-23 10:06:51,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-23 10:06:51,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-23 10:06:51,882 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-23 10:06:51,883 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1690107411883 2023-07-23 10:06:51,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-23 10:06:51,883 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-23 10:06:51,884 DEBUG [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-23 10:06:51,884 DEBUG [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-23 10:06:51,884 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-23 10:06:51,885 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-23 10:06:51,886 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 5 msec 2023-07-23 10:06:51,887 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-23 10:06:51,888 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1690107411888 2023-07-23 10:06:51,899 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-23 10:06:51,899 INFO [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-23 10:06:51,899 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:06:51,900 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-23 10:06:51,900 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-23 10:06:51,900 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 10:06:51,900 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-23 10:06:51,901 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:51,901 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:06:51,901 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:06:51,901 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:06:51,902 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:06:51,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:06:51,902 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:51,902 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:06:51,902 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:51,902 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:06:51,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:06:51,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:06:51,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-23 10:06:51,902 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:51,902 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-23 10:06:51,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-23 10:06:51,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-23 10:06:51,902 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 10:06:51,903 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 10:06:51,903 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 10:06:51,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-23 10:06:51,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-23 10:06:51,903 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-23 10:06:51,903 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-23 10:06:51,903 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-23 10:06:51,904 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:06:51,904 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-23 10:06:51,904 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-23 10:06:51,904 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39563,1690106767800' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-23 10:06:51,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-23 10:06:51,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-23 10:06:51,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-23 10:06:51,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-23 10:06:51,905 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-23 10:06:51,905 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-23 10:06:51,905 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-23 10:06:51,905 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-23 10:06:51,905 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-23 10:06:51,905 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-23 10:06:51,905 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:06:51,905 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:06:51,906 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-23 10:06:51,907 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-23 10:06:51,907 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-23 10:06:51,907 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-23 10:06:51,907 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36827,1690106767853' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-23 10:06:51,907 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36599,1690106767729' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-23 10:06:51,910 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:51,910 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 10:06:51,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:51,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:06:51,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:06:51,911 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:51,911 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 10:06:51,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:06:51,911 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 10:06:51,911 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 10:06:51,911 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 10:06:51,912 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 10:06:51,912 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 10:06:51,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:06:51,912 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 10:06:51,912 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 10:06:51,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-23 10:06:51,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:51,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:51,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:51,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:06:51,913 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39563,1690106767800' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-23 10:06:51,913 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1ad4af2[Count = 1] remaining members to acquire global barrier 2023-07-23 10:06:51,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:51,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:06:51,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:06:51,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:06:51,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:06:51,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-23 10:06:51,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:51,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:51,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:51,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:06:51,915 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36827,1690106767853' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-23 10:06:51,915 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1ad4af2[Count = 0] remaining members to acquire global barrier 2023-07-23 10:06:51,915 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-23 10:06:51,915 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 10:06:51,916 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 10:06:51,916 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 10:06:51,916 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 10:06:51,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 10:06:51,916 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 10:06:51,917 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-23 10:06:51,917 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:51,917 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 10:06:51,917 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 10:06:51,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 10:06:51,917 DEBUG [rs(jenkins-hbase4.apache.org,39563,1690106767800)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1690106810855.0de37c8a326acd4b5160339a10a464bb. 2023-07-23 10:06:51,917 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-23 10:06:51,917 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 10:06:51,917 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:51,917 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-23 10:06:51,917 DEBUG [rs(jenkins-hbase4.apache.org,39563,1690106767800)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1690106810855.0de37c8a326acd4b5160339a10a464bb. started... 2023-07-23 10:06:51,917 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 10:06:51,917 DEBUG [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1690106810855.3e08df92b9aac5347059674256892a79. 2023-07-23 10:06:51,917 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 10:06:51,917 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 10:06:51,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 10:06:51,917 INFO [rs(jenkins-hbase4.apache.org,39563,1690106767800)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 0de37c8a326acd4b5160339a10a464bb 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-23 10:06:51,917 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-23 10:06:51,917 DEBUG [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1690106810855.3e08df92b9aac5347059674256892a79. started... 2023-07-23 10:06:51,918 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-23 10:06:51,918 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,36599,1690106767729' in zk 2023-07-23 10:06:51,918 INFO [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 3e08df92b9aac5347059674256892a79 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-23 10:06:51,920 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-23 10:06:51,920 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:06:51,920 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-23 10:06:51,952 INFO [rs(jenkins-hbase4.apache.org,39563,1690106767800)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230723c48a1a682b9649d3a822148374194b52 to hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230723c48a1a682b9649d3a822148374194b52 2023-07-23 10:06:51,952 INFO [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307233127b1bbcc7f47828c70d72d0e97ad35 to hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307233127b1bbcc7f47828c70d72d0e97ad35 2023-07-23 10:06:51,969 INFO [rs(jenkins-hbase4.apache.org,39563,1690106767800)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testConsecutiveExports/0de37c8a326acd4b5160339a10a464bb/.tmp/cf/2c046b3db9c84d51989220847ff8308f 2023-07-23 10:06:51,975 INFO [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testConsecutiveExports/3e08df92b9aac5347059674256892a79/.tmp/cf/bead57bf3ad84a88bbc158ab9efbf0d2 2023-07-23 10:06:51,980 DEBUG [rs(jenkins-hbase4.apache.org,39563,1690106767800)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testConsecutiveExports/0de37c8a326acd4b5160339a10a464bb/.tmp/cf/2c046b3db9c84d51989220847ff8308f as hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testConsecutiveExports/0de37c8a326acd4b5160339a10a464bb/cf/2c046b3db9c84d51989220847ff8308f 2023-07-23 10:06:51,981 DEBUG [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testConsecutiveExports/3e08df92b9aac5347059674256892a79/.tmp/cf/bead57bf3ad84a88bbc158ab9efbf0d2 as hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testConsecutiveExports/3e08df92b9aac5347059674256892a79/cf/bead57bf3ad84a88bbc158ab9efbf0d2 2023-07-23 10:06:51,984 DEBUG [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 10:06:51,985 INFO [rs(jenkins-hbase4.apache.org,39563,1690106767800)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testConsecutiveExports/0de37c8a326acd4b5160339a10a464bb/cf/2c046b3db9c84d51989220847ff8308f, entries=46, sequenceid=6, filesize=12.5 K 2023-07-23 10:06:51,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-23 10:06:51,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-23 10:06:51,986 DEBUG [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-23 10:06:51,986 INFO [rs(jenkins-hbase4.apache.org,39563,1690106767800)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 0de37c8a326acd4b5160339a10a464bb in 69ms, sequenceid=6, compaction requested=false 2023-07-23 10:06:51,986 DEBUG [rs(jenkins-hbase4.apache.org,39563,1690106767800)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-23 10:06:51,986 DEBUG [rs(jenkins-hbase4.apache.org,39563,1690106767800)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0de37c8a326acd4b5160339a10a464bb: 2023-07-23 10:06:51,987 DEBUG [rs(jenkins-hbase4.apache.org,39563,1690106767800)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1690106810855.0de37c8a326acd4b5160339a10a464bb.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-23 10:06:51,987 DEBUG [rs(jenkins-hbase4.apache.org,39563,1690106767800)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 10:06:51,987 DEBUG [rs(jenkins-hbase4.apache.org,39563,1690106767800)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testConsecutiveExports/0de37c8a326acd4b5160339a10a464bb/cf/2c046b3db9c84d51989220847ff8308f] hfiles 2023-07-23 10:06:51,987 DEBUG [rs(jenkins-hbase4.apache.org,39563,1690106767800)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testConsecutiveExports/0de37c8a326acd4b5160339a10a464bb/cf/2c046b3db9c84d51989220847ff8308f for snapshot=snaptb0-testConsecutiveExports 2023-07-23 10:06:51,987 INFO [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testConsecutiveExports/3e08df92b9aac5347059674256892a79/cf/bead57bf3ad84a88bbc158ab9efbf0d2, entries=4, sequenceid=6, filesize=5.6 K 2023-07-23 10:06:51,988 INFO [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 3e08df92b9aac5347059674256892a79 in 70ms, sequenceid=6, compaction requested=false 2023-07-23 10:06:51,989 DEBUG [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3e08df92b9aac5347059674256892a79: 2023-07-23 10:06:51,989 DEBUG [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1690106810855.3e08df92b9aac5347059674256892a79.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-23 10:06:51,989 DEBUG [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 10:06:51,989 DEBUG [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testConsecutiveExports/3e08df92b9aac5347059674256892a79/cf/bead57bf3ad84a88bbc158ab9efbf0d2] hfiles 2023-07-23 10:06:51,990 DEBUG [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testConsecutiveExports/3e08df92b9aac5347059674256892a79/cf/bead57bf3ad84a88bbc158ab9efbf0d2 for snapshot=snaptb0-testConsecutiveExports 2023-07-23 10:06:51,999 DEBUG [rs(jenkins-hbase4.apache.org,39563,1690106767800)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1690106810855.0de37c8a326acd4b5160339a10a464bb. completed. 2023-07-23 10:06:51,999 DEBUG [rs(jenkins-hbase4.apache.org,39563,1690106767800)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1690106810855.0de37c8a326acd4b5160339a10a464bb. 2023-07-23 10:06:51,999 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 10:06:51,999 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 10:06:51,999 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:51,999 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-23 10:06:51,999 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,39563,1690106767800' in zk 2023-07-23 10:06:52,001 DEBUG [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1690106810855.3e08df92b9aac5347059674256892a79. completed. 2023-07-23 10:06:52,001 DEBUG [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1690106810855.3e08df92b9aac5347059674256892a79. 2023-07-23 10:06:52,002 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 10:06:52,002 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 10:06:52,002 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:52,002 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-23 10:06:52,002 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:52,002 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,36827,1690106767853' in zk 2023-07-23 10:06:52,002 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-23 10:06:52,002 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:06:52,002 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-23 10:06:52,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:52,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:06:52,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:06:52,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:06:52,005 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-23 10:06:52,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:06:52,005 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:06:52,005 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:52,005 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-23 10:06:52,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-23 10:06:52,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:52,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:52,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:52,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:06:52,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-23 10:06:52,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:52,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:52,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:52,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,39563,1690106767800': 2023-07-23 10:06:52,010 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39563,1690106767800' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-23 10:06:52,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:52,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:06:52,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:06:52,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:06:52,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:06:52,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-23 10:06:52,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:52,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:52,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:52,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:06:52,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-23 10:06:52,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:52,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:52,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:52,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,36827,1690106767853': 2023-07-23 10:06:52,015 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36827,1690106767853' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-23 10:06:52,015 INFO [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-23 10:06:52,015 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-23 10:06:52,015 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-23 10:06:52,015 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-23 10:06:52,015 INFO [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-23 10:06:52,017 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 10:06:52,017 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 10:06:52,017 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 10:06:52,017 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:06:52,017 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 10:06:52,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 10:06:52,017 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 10:06:52,017 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:06:52,017 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 10:06:52,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 10:06:52,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 10:06:52,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:06:52,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:06:52,018 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:06:52,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:06:52,017 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 10:06:52,017 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:06:52,018 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:06:52,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:06:52,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 10:06:52,018 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:52,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:06:52,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 10:06:52,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 10:06:52,018 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:06:52,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:06:52,019 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:52,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-23 10:06:52,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 10:06:52,019 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:52,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:06:52,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-23 10:06:52,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:52,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:52,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:52,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:06:52,021 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:52,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-23 10:06:52,024 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:52,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:52,025 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:52,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:52,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:52,036 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:06:52,036 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:06:52,036 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:06:52,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:06:52,036 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:06:52,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:06:52,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:06:52,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:06:52,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:06:52,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:06:52,036 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:06:52,036 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:06:52,036 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:52,037 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-23 10:06:52,037 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:52,037 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:52,037 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-23 10:06:52,037 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:06:52,037 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 10:06:52,037 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:06:52,037 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:06:52,037 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:06:52,037 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:06:52,037 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:06:52,039 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:06:52,038 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 10:06:52,037 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-23 10:06:52,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:06:52,039 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-23 10:06:52,039 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 10:06:52,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:06:52,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:06:52,039 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-23 10:06:52,039 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-23 10:06:52,040 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230723c48a1a682b9649d3a822148374194b52, hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307233127b1bbcc7f47828c70d72d0e97ad35] mob files 2023-07-23 10:06:52,040 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230723c48a1a682b9649d3a822148374194b52 2023-07-23 10:06:52,040 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307233127b1bbcc7f47828c70d72d0e97ad35 2023-07-23 10:06:52,055 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-23 10:06:52,056 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-23 10:06:52,083 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-23 10:06:52,112 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-23 10:06:52,112 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-23 10:06:52,113 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-23 10:06:52,113 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1690106811883Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1690106812055 (+172 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1690106812055Loading Region manifests for snaptb0-testConsecutiveExports at 1690106812055Writing data manifest for snaptb0-testConsecutiveExports at 1690106812064 (+9 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1690106812075 (+11 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1690106812112 (+37 ms) 2023-07-23 10:06:52,115 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-23 10:06:52,117 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 231 msec 2023-07-23 10:06:52,186 DEBUG [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 10:06:52,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-23 10:06:52,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-23 10:06:52,188 INFO [Listener at jenkins-hbase4.apache.org/44565] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f0c2d64d-3350-bc69-1c38-d6964a44400f/local-export-1690106812187 2023-07-23 10:06:52,188 INFO [Listener at jenkins-hbase4.apache.org/44565] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f0c2d64d-3350-bc69-1c38-d6964a44400f/local-export-1690106812187, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f0c2d64d-3350-bc69-1c38-d6964a44400f/local-export-1690106812187, srcFsUri=hdfs://localhost:37479, srcDir=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528 2023-07-23 10:06:52,210 DEBUG [Listener at jenkins-hbase4.apache.org/44565] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:37479, inputRoot=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528 2023-07-23 10:06:52,210 DEBUG [Listener at jenkins-hbase4.apache.org/44565] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@474e4c57, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f0c2d64d-3350-bc69-1c38-d6964a44400f/local-export-1690106812187, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f0c2d64d-3350-bc69-1c38-d6964a44400f/local-export-1690106812187/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-23 10:06:52,210 INFO [Listener at jenkins-hbase4.apache.org/44565] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:37479, inputRoot=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528, snapshotDir=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-23 10:06:52,219 INFO [Listener at jenkins-hbase4.apache.org/44565] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f0c2d64d-3350-bc69-1c38-d6964a44400f/local-export-1690106812187/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-23 10:06:52,231 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-23 10:06:52,231 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-23 10:06:52,232 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-23 10:06:52,232 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-23 10:06:52,232 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-23 10:06:52,233 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-23 10:06:52,233 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-23 10:06:52,308 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f0c2d64d-3350-bc69-1c38-d6964a44400f/hadoop-7243154218690771888.jar 2023-07-23 10:06:52,309 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-23 10:06:52,309 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-23 10:06:52,310 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-23 10:06:52,310 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-23 10:06:52,310 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-23 10:06:52,310 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-23 10:06:52,311 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-23 10:06:52,311 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-23 10:06:52,312 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-23 10:06:52,312 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-23 10:06:52,312 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-23 10:06:52,313 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-23 10:06:52,313 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-23 10:06:52,313 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-23 10:06:52,314 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-23 10:06:52,314 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-23 10:06:52,315 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 10:06:52,315 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 10:06:52,315 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 10:06:52,316 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 10:06:52,316 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 10:06:52,316 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 10:06:52,317 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 10:06:52,714 WARN [Listener at jenkins-hbase4.apache.org/44565] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-23 10:06:52,717 INFO [Listener at jenkins-hbase4.apache.org/44565] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-23 10:06:52,719 DEBUG [Listener at jenkins-hbase4.apache.org/44565] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-23 10:06:54,669 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 10:06:54,669 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 10:06:54,672 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690106775176_0002_000001 (auth:SIMPLE) 2023-07-23 10:06:55,249 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690106775176_0003_000001 (auth:SIMPLE) 2023-07-23 10:06:56,154 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-23 10:06:59,345 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690106775176_0003_000001 (auth:SIMPLE) 2023-07-23 10:07:01,630 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690106775176_0003_000001 (auth:SIMPLE) 2023-07-23 10:07:04,727 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690106775176_0003_000001 (auth:SIMPLE) 2023-07-23 10:07:05,953 INFO [Listener at jenkins-hbase4.apache.org/44565] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-23 10:07:05,953 INFO [Listener at jenkins-hbase4.apache.org/44565] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-23 10:07:05,959 INFO [Listener at jenkins-hbase4.apache.org/44565] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-23 10:07:05,960 INFO [Listener at jenkins-hbase4.apache.org/44565] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-23 10:07:05,960 INFO [Listener at jenkins-hbase4.apache.org/44565] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-23 10:07:05,961 DEBUG [Listener at jenkins-hbase4.apache.org/44565] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-165846724_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-23 10:07:05,961 DEBUG [Listener at jenkins-hbase4.apache.org/44565] snapshot.TestExportSnapshot(367): hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-23 10:07:05,962 DEBUG [Listener at jenkins-hbase4.apache.org/44565] snapshot.TestExportSnapshot(367): hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-23 10:07:05,962 DEBUG [Listener at jenkins-hbase4.apache.org/44565] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@1253e9c in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f0c2d64d-3350-bc69-1c38-d6964a44400f/local-export-1690106812187/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f0c2d64d-3350-bc69-1c38-d6964a44400f/local-export-1690106812187/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-23 10:07:05,962 DEBUG [Listener at jenkins-hbase4.apache.org/44565] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f0c2d64d-3350-bc69-1c38-d6964a44400f/local-export-1690106812187/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-23 10:07:05,962 DEBUG [Listener at jenkins-hbase4.apache.org/44565] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f0c2d64d-3350-bc69-1c38-d6964a44400f/local-export-1690106812187/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-23 10:07:05,964 INFO [Listener at jenkins-hbase4.apache.org/44565] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f0c2d64d-3350-bc69-1c38-d6964a44400f/local-export-1690106812187, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f0c2d64d-3350-bc69-1c38-d6964a44400f/local-export-1690106812187, srcFsUri=hdfs://localhost:37479, srcDir=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528 2023-07-23 10:07:05,998 DEBUG [Listener at jenkins-hbase4.apache.org/44565] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:37479, inputRoot=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528 2023-07-23 10:07:05,998 DEBUG [Listener at jenkins-hbase4.apache.org/44565] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@6977da86, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f0c2d64d-3350-bc69-1c38-d6964a44400f/local-export-1690106812187, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f0c2d64d-3350-bc69-1c38-d6964a44400f/local-export-1690106812187/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-23 10:07:05,998 INFO [Listener at jenkins-hbase4.apache.org/44565] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:37479, inputRoot=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528, snapshotDir=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-23 10:07:06,016 INFO [Listener at jenkins-hbase4.apache.org/44565] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f0c2d64d-3350-bc69-1c38-d6964a44400f/local-export-1690106812187/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-23 10:07:06,032 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-23 10:07:06,032 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-23 10:07:06,032 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-23 10:07:06,033 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-23 10:07:06,033 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-23 10:07:06,034 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-23 10:07:06,034 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-23 10:07:06,114 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f0c2d64d-3350-bc69-1c38-d6964a44400f/hadoop-2689285042703369046.jar 2023-07-23 10:07:06,114 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-23 10:07:06,115 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-23 10:07:06,116 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-23 10:07:06,116 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-23 10:07:06,117 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-23 10:07:06,117 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-23 10:07:06,118 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-23 10:07:06,118 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-23 10:07:06,119 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-23 10:07:06,120 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-23 10:07:06,120 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-23 10:07:06,121 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-23 10:07:06,121 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-23 10:07:06,122 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-23 10:07:06,122 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-23 10:07:06,123 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-23 10:07:06,124 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 10:07:06,124 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 10:07:06,125 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 10:07:06,125 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 10:07:06,126 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 10:07:06,126 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 10:07:06,127 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 10:07:06,635 WARN [Listener at jenkins-hbase4.apache.org/44565] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-23 10:07:06,637 INFO [Listener at jenkins-hbase4.apache.org/44565] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-23 10:07:06,640 DEBUG [Listener at jenkins-hbase4.apache.org/44565] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-23 10:07:10,909 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 10:07:10,909 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 10:07:10,912 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690106775176_0003_000001 (auth:SIMPLE) 2023-07-23 10:07:11,703 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690106775176_0004_000001 (auth:SIMPLE) 2023-07-23 10:07:15,822 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690106775176_0004_000001 (auth:SIMPLE) 2023-07-23 10:07:18,162 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690106775176_0004_000001 (auth:SIMPLE) 2023-07-23 10:07:21,306 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690106775176_0004_000001 (auth:SIMPLE) 2023-07-23 10:07:22,883 INFO [Listener at jenkins-hbase4.apache.org/44565] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-23 10:07:22,884 INFO [Listener at jenkins-hbase4.apache.org/44565] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-23 10:07:22,887 INFO [Listener at jenkins-hbase4.apache.org/44565] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-23 10:07:22,887 INFO [Listener at jenkins-hbase4.apache.org/44565] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-23 10:07:22,888 INFO [Listener at jenkins-hbase4.apache.org/44565] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-23 10:07:22,888 DEBUG [Listener at jenkins-hbase4.apache.org/44565] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-165846724_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-23 10:07:22,891 DEBUG [Listener at jenkins-hbase4.apache.org/44565] snapshot.TestExportSnapshot(367): hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-23 10:07:22,891 DEBUG [Listener at jenkins-hbase4.apache.org/44565] snapshot.TestExportSnapshot(367): hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-23 10:07:22,891 DEBUG [Listener at jenkins-hbase4.apache.org/44565] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@1253e9c in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f0c2d64d-3350-bc69-1c38-d6964a44400f/local-export-1690106812187/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f0c2d64d-3350-bc69-1c38-d6964a44400f/local-export-1690106812187/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-23 10:07:22,891 DEBUG [Listener at jenkins-hbase4.apache.org/44565] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f0c2d64d-3350-bc69-1c38-d6964a44400f/local-export-1690106812187/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-23 10:07:22,891 DEBUG [Listener at jenkins-hbase4.apache.org/44565] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f0c2d64d-3350-bc69-1c38-d6964a44400f/local-export-1690106812187/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-23 10:07:22,910 INFO [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-23 10:07:22,911 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-07-23 10:07:22,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-23 10:07:22,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-23 10:07:22,921 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690106842921"}]},"ts":"1690106842921"} 2023-07-23 10:07:22,924 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-23 10:07:22,927 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-23 10:07:22,928 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=3e08df92b9aac5347059674256892a79, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0de37c8a326acd4b5160339a10a464bb, UNASSIGN}] 2023-07-23 10:07:22,930 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0de37c8a326acd4b5160339a10a464bb, UNASSIGN 2023-07-23 10:07:22,930 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=3e08df92b9aac5347059674256892a79, UNASSIGN 2023-07-23 10:07:22,933 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=0de37c8a326acd4b5160339a10a464bb, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:07:22,933 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=3e08df92b9aac5347059674256892a79, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:07:22,933 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1690106810855.0de37c8a326acd4b5160339a10a464bb.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690106842933"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690106842933"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690106842933"}]},"ts":"1690106842933"} 2023-07-23 10:07:22,933 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1690106810855.3e08df92b9aac5347059674256892a79.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690106842933"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690106842933"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690106842933"}]},"ts":"1690106842933"} 2023-07-23 10:07:22,936 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=53, state=RUNNABLE; CloseRegionProcedure 0de37c8a326acd4b5160339a10a464bb, server=jenkins-hbase4.apache.org,39563,1690106767800}] 2023-07-23 10:07:22,937 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=52, state=RUNNABLE; CloseRegionProcedure 3e08df92b9aac5347059674256892a79, server=jenkins-hbase4.apache.org,36827,1690106767853}] 2023-07-23 10:07:23,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-23 10:07:23,089 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 0de37c8a326acd4b5160339a10a464bb 2023-07-23 10:07:23,089 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0de37c8a326acd4b5160339a10a464bb, disabling compactions & flushes 2023-07-23 10:07:23,089 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1690106810855.0de37c8a326acd4b5160339a10a464bb. 2023-07-23 10:07:23,089 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1690106810855.0de37c8a326acd4b5160339a10a464bb. 2023-07-23 10:07:23,089 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1690106810855.0de37c8a326acd4b5160339a10a464bb. after waiting 0 ms 2023-07-23 10:07:23,089 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1690106810855.0de37c8a326acd4b5160339a10a464bb. 2023-07-23 10:07:23,091 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 3e08df92b9aac5347059674256892a79 2023-07-23 10:07:23,091 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 3e08df92b9aac5347059674256892a79, disabling compactions & flushes 2023-07-23 10:07:23,091 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1690106810855.3e08df92b9aac5347059674256892a79. 2023-07-23 10:07:23,091 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1690106810855.3e08df92b9aac5347059674256892a79. 2023-07-23 10:07:23,091 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1690106810855.3e08df92b9aac5347059674256892a79. after waiting 0 ms 2023-07-23 10:07:23,091 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1690106810855.3e08df92b9aac5347059674256892a79. 2023-07-23 10:07:23,112 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testConsecutiveExports/0de37c8a326acd4b5160339a10a464bb/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-23 10:07:23,114 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 10:07:23,116 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1690106810855.0de37c8a326acd4b5160339a10a464bb. 2023-07-23 10:07:23,116 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0de37c8a326acd4b5160339a10a464bb: 2023-07-23 10:07:23,117 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testConsecutiveExports/3e08df92b9aac5347059674256892a79/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-23 10:07:23,118 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 10:07:23,119 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 0de37c8a326acd4b5160339a10a464bb 2023-07-23 10:07:23,119 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1690106810855.3e08df92b9aac5347059674256892a79. 2023-07-23 10:07:23,119 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 3e08df92b9aac5347059674256892a79: 2023-07-23 10:07:23,119 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=0de37c8a326acd4b5160339a10a464bb, regionState=CLOSED 2023-07-23 10:07:23,119 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1690106810855.0de37c8a326acd4b5160339a10a464bb.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690106843119"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690106843119"}]},"ts":"1690106843119"} 2023-07-23 10:07:23,120 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 3e08df92b9aac5347059674256892a79 2023-07-23 10:07:23,121 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=3e08df92b9aac5347059674256892a79, regionState=CLOSED 2023-07-23 10:07:23,121 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1690106810855.3e08df92b9aac5347059674256892a79.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690106843121"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690106843121"}]},"ts":"1690106843121"} 2023-07-23 10:07:23,124 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=53 2023-07-23 10:07:23,124 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=53, state=SUCCESS; CloseRegionProcedure 0de37c8a326acd4b5160339a10a464bb, server=jenkins-hbase4.apache.org,39563,1690106767800 in 185 msec 2023-07-23 10:07:23,125 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=52 2023-07-23 10:07:23,125 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=52, state=SUCCESS; CloseRegionProcedure 3e08df92b9aac5347059674256892a79, server=jenkins-hbase4.apache.org,36827,1690106767853 in 185 msec 2023-07-23 10:07:23,126 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0de37c8a326acd4b5160339a10a464bb, UNASSIGN in 196 msec 2023-07-23 10:07:23,126 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=51 2023-07-23 10:07:23,126 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=3e08df92b9aac5347059674256892a79, UNASSIGN in 197 msec 2023-07-23 10:07:23,127 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690106843127"}]},"ts":"1690106843127"} 2023-07-23 10:07:23,129 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-23 10:07:23,133 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-23 10:07:23,135 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 223 msec 2023-07-23 10:07:23,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-23 10:07:23,225 INFO [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-23 10:07:23,226 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-07-23 10:07:23,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-23 10:07:23,230 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-23 10:07:23,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-23 10:07:23,231 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-23 10:07:23,234 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39563] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-23 10:07:23,237 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-23 10:07:23,237 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-23 10:07:23,237 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-23 10:07:23,237 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-23 10:07:23,237 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-23 10:07:23,237 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-23 10:07:23,238 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-23 10:07:23,239 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testConsecutiveExports/3e08df92b9aac5347059674256892a79 2023-07-23 10:07:23,239 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testConsecutiveExports/0de37c8a326acd4b5160339a10a464bb 2023-07-23 10:07:23,240 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-23 10:07:23,240 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-23 10:07:23,240 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:07:23,240 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data null 2023-07-23 10:07:23,240 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:07:23,240 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-23 10:07:23,240 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-23 10:07:23,240 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:07:23,240 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:07:23,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-23 10:07:23,241 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testConsecutiveExports/3e08df92b9aac5347059674256892a79/cf, FileablePath, hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testConsecutiveExports/3e08df92b9aac5347059674256892a79/recovered.edits] 2023-07-23 10:07:23,242 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testConsecutiveExports/0de37c8a326acd4b5160339a10a464bb/cf, FileablePath, hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testConsecutiveExports/0de37c8a326acd4b5160339a10a464bb/recovered.edits] 2023-07-23 10:07:23,248 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testConsecutiveExports/3e08df92b9aac5347059674256892a79/cf/bead57bf3ad84a88bbc158ab9efbf0d2 to hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/archive/data/default/testtb-testConsecutiveExports/3e08df92b9aac5347059674256892a79/cf/bead57bf3ad84a88bbc158ab9efbf0d2 2023-07-23 10:07:23,248 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testConsecutiveExports/0de37c8a326acd4b5160339a10a464bb/cf/2c046b3db9c84d51989220847ff8308f to hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/archive/data/default/testtb-testConsecutiveExports/0de37c8a326acd4b5160339a10a464bb/cf/2c046b3db9c84d51989220847ff8308f 2023-07-23 10:07:23,251 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testConsecutiveExports/3e08df92b9aac5347059674256892a79/recovered.edits/9.seqid to hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/archive/data/default/testtb-testConsecutiveExports/3e08df92b9aac5347059674256892a79/recovered.edits/9.seqid 2023-07-23 10:07:23,252 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testConsecutiveExports/0de37c8a326acd4b5160339a10a464bb/recovered.edits/9.seqid to hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/archive/data/default/testtb-testConsecutiveExports/0de37c8a326acd4b5160339a10a464bb/recovered.edits/9.seqid 2023-07-23 10:07:23,252 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testConsecutiveExports/3e08df92b9aac5347059674256892a79 2023-07-23 10:07:23,252 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testConsecutiveExports/0de37c8a326acd4b5160339a10a464bb 2023-07-23 10:07:23,252 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-23 10:07:23,253 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-23 10:07:23,254 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-07-23 10:07:23,257 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230723c48a1a682b9649d3a822148374194b52 to hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230723c48a1a682b9649d3a822148374194b52 2023-07-23 10:07:23,258 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307233127b1bbcc7f47828c70d72d0e97ad35 to hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307233127b1bbcc7f47828c70d72d0e97ad35 2023-07-23 10:07:23,259 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-23 10:07:23,261 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-23 10:07:23,264 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-23 10:07:23,266 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-23 10:07:23,267 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-23 10:07:23,267 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-23 10:07:23,268 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1690106810855.3e08df92b9aac5347059674256892a79.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690106843267"}]},"ts":"9223372036854775807"} 2023-07-23 10:07:23,268 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1690106810855.0de37c8a326acd4b5160339a10a464bb.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690106843267"}]},"ts":"9223372036854775807"} 2023-07-23 10:07:23,269 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-23 10:07:23,269 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 3e08df92b9aac5347059674256892a79, NAME => 'testtb-testConsecutiveExports,,1690106810855.3e08df92b9aac5347059674256892a79.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 0de37c8a326acd4b5160339a10a464bb, NAME => 'testtb-testConsecutiveExports,1,1690106810855.0de37c8a326acd4b5160339a10a464bb.', STARTKEY => '1', ENDKEY => ''}] 2023-07-23 10:07:23,269 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-23 10:07:23,270 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690106843269"}]},"ts":"9223372036854775807"} 2023-07-23 10:07:23,271 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-23 10:07:23,273 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-23 10:07:23,275 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 46 msec 2023-07-23 10:07:23,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-23 10:07:23,343 INFO [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-23 10:07:23,351 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-23 10:07:23,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-23 10:07:23,355 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-07-23 10:07:23,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-23 10:07:23,384 INFO [Listener at jenkins-hbase4.apache.org/44565] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=748 (was 762), OpenFileDescriptor=907 (was 922), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=337 (was 283) - SystemLoadAverage LEAK? -, ProcessCount=176 (was 179), AvailableMemoryMB=6958 (was 6453) - AvailableMemoryMB LEAK? - 2023-07-23 10:07:23,384 WARN [Listener at jenkins-hbase4.apache.org/44565] hbase.ResourceChecker(130): Thread=748 is superior to 500 2023-07-23 10:07:23,407 INFO [Listener at jenkins-hbase4.apache.org/44565] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=748, OpenFileDescriptor=907, MaxFileDescriptor=60000, SystemLoadAverage=337, ProcessCount=176, AvailableMemoryMB=6957 2023-07-23 10:07:23,407 WARN [Listener at jenkins-hbase4.apache.org/44565] hbase.ResourceChecker(130): Thread=748 is superior to 500 2023-07-23 10:07:23,409 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-23 10:07:23,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:23,412 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-23 10:07:23,412 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-23 10:07:23,413 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-23 10:07:23,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-23 10:07:23,415 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/252a1ea38016c2dfc1f1109b2d0063b5 2023-07-23 10:07:23,415 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0b562e5c83406565c5384eccba86910a 2023-07-23 10:07:23,416 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/252a1ea38016c2dfc1f1109b2d0063b5 empty. 2023-07-23 10:07:23,416 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0b562e5c83406565c5384eccba86910a empty. 2023-07-23 10:07:23,416 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0b562e5c83406565c5384eccba86910a 2023-07-23 10:07:23,417 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/252a1ea38016c2dfc1f1109b2d0063b5 2023-07-23 10:07:23,417 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-23 10:07:23,426 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-23 10:07:23,428 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 252a1ea38016c2dfc1f1109b2d0063b5, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1690106843408.252a1ea38016c2dfc1f1109b2d0063b5.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp 2023-07-23 10:07:23,428 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 0b562e5c83406565c5384eccba86910a, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1690106843408.0b562e5c83406565c5384eccba86910a.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp 2023-07-23 10:07:23,443 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1690106843408.252a1ea38016c2dfc1f1109b2d0063b5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 10:07:23,444 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 252a1ea38016c2dfc1f1109b2d0063b5, disabling compactions & flushes 2023-07-23 10:07:23,444 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1690106843408.252a1ea38016c2dfc1f1109b2d0063b5. 2023-07-23 10:07:23,444 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1690106843408.252a1ea38016c2dfc1f1109b2d0063b5. 2023-07-23 10:07:23,444 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1690106843408.252a1ea38016c2dfc1f1109b2d0063b5. after waiting 0 ms 2023-07-23 10:07:23,444 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1690106843408.252a1ea38016c2dfc1f1109b2d0063b5. 2023-07-23 10:07:23,444 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1690106843408.252a1ea38016c2dfc1f1109b2d0063b5. 2023-07-23 10:07:23,444 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 252a1ea38016c2dfc1f1109b2d0063b5: 2023-07-23 10:07:23,444 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1690106843408.0b562e5c83406565c5384eccba86910a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 10:07:23,444 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 0b562e5c83406565c5384eccba86910a, disabling compactions & flushes 2023-07-23 10:07:23,444 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1690106843408.0b562e5c83406565c5384eccba86910a. 2023-07-23 10:07:23,444 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1690106843408.0b562e5c83406565c5384eccba86910a. 2023-07-23 10:07:23,444 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1690106843408.0b562e5c83406565c5384eccba86910a. after waiting 0 ms 2023-07-23 10:07:23,444 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1690106843408.0b562e5c83406565c5384eccba86910a. 2023-07-23 10:07:23,444 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1690106843408.0b562e5c83406565c5384eccba86910a. 2023-07-23 10:07:23,444 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 0b562e5c83406565c5384eccba86910a: 2023-07-23 10:07:23,447 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-23 10:07:23,448 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690106843408.252a1ea38016c2dfc1f1109b2d0063b5.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690106843447"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690106843447"}]},"ts":"1690106843447"} 2023-07-23 10:07:23,448 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690106843408.0b562e5c83406565c5384eccba86910a.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690106843447"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690106843447"}]},"ts":"1690106843447"} 2023-07-23 10:07:23,454 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-23 10:07:23,455 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-23 10:07:23,455 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690106843455"}]},"ts":"1690106843455"} 2023-07-23 10:07:23,456 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-23 10:07:23,459 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-23 10:07:23,461 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-23 10:07:23,461 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-23 10:07:23,461 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-23 10:07:23,461 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-23 10:07:23,461 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=252a1ea38016c2dfc1f1109b2d0063b5, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0b562e5c83406565c5384eccba86910a, ASSIGN}] 2023-07-23 10:07:23,463 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0b562e5c83406565c5384eccba86910a, ASSIGN 2023-07-23 10:07:23,464 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=252a1ea38016c2dfc1f1109b2d0063b5, ASSIGN 2023-07-23 10:07:23,464 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0b562e5c83406565c5384eccba86910a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36827,1690106767853; forceNewPlan=false, retain=false 2023-07-23 10:07:23,464 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=252a1ea38016c2dfc1f1109b2d0063b5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36599,1690106767729; forceNewPlan=false, retain=false 2023-07-23 10:07:23,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-23 10:07:23,614 INFO [jenkins-hbase4:34097] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-23 10:07:23,617 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=252a1ea38016c2dfc1f1109b2d0063b5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:07:23,617 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=0b562e5c83406565c5384eccba86910a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:07:23,617 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690106843408.252a1ea38016c2dfc1f1109b2d0063b5.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690106843617"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690106843617"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690106843617"}]},"ts":"1690106843617"} 2023-07-23 10:07:23,617 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690106843408.0b562e5c83406565c5384eccba86910a.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690106843617"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690106843617"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690106843617"}]},"ts":"1690106843617"} 2023-07-23 10:07:23,619 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=58, state=RUNNABLE; OpenRegionProcedure 252a1ea38016c2dfc1f1109b2d0063b5, server=jenkins-hbase4.apache.org,36599,1690106767729}] 2023-07-23 10:07:23,621 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=59, state=RUNNABLE; OpenRegionProcedure 0b562e5c83406565c5384eccba86910a, server=jenkins-hbase4.apache.org,36827,1690106767853}] 2023-07-23 10:07:23,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-23 10:07:23,778 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1690106843408.252a1ea38016c2dfc1f1109b2d0063b5. 2023-07-23 10:07:23,778 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 252a1ea38016c2dfc1f1109b2d0063b5, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1690106843408.252a1ea38016c2dfc1f1109b2d0063b5.', STARTKEY => '', ENDKEY => '1'} 2023-07-23 10:07:23,778 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1690106843408.252a1ea38016c2dfc1f1109b2d0063b5. service=AccessControlService 2023-07-23 10:07:23,778 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1690106843408.0b562e5c83406565c5384eccba86910a. 2023-07-23 10:07:23,779 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 10:07:23,779 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0b562e5c83406565c5384eccba86910a, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1690106843408.0b562e5c83406565c5384eccba86910a.', STARTKEY => '1', ENDKEY => ''} 2023-07-23 10:07:23,779 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 252a1ea38016c2dfc1f1109b2d0063b5 2023-07-23 10:07:23,779 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1690106843408.252a1ea38016c2dfc1f1109b2d0063b5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 10:07:23,779 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 252a1ea38016c2dfc1f1109b2d0063b5 2023-07-23 10:07:23,779 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1690106843408.0b562e5c83406565c5384eccba86910a. service=AccessControlService 2023-07-23 10:07:23,779 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 252a1ea38016c2dfc1f1109b2d0063b5 2023-07-23 10:07:23,779 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 10:07:23,779 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 0b562e5c83406565c5384eccba86910a 2023-07-23 10:07:23,780 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1690106843408.0b562e5c83406565c5384eccba86910a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 10:07:23,780 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0b562e5c83406565c5384eccba86910a 2023-07-23 10:07:23,780 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0b562e5c83406565c5384eccba86910a 2023-07-23 10:07:23,780 INFO [StoreOpener-252a1ea38016c2dfc1f1109b2d0063b5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 252a1ea38016c2dfc1f1109b2d0063b5 2023-07-23 10:07:23,781 INFO [StoreOpener-0b562e5c83406565c5384eccba86910a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0b562e5c83406565c5384eccba86910a 2023-07-23 10:07:23,782 DEBUG [StoreOpener-252a1ea38016c2dfc1f1109b2d0063b5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemStateWithMergeRegion/252a1ea38016c2dfc1f1109b2d0063b5/cf 2023-07-23 10:07:23,782 DEBUG [StoreOpener-252a1ea38016c2dfc1f1109b2d0063b5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemStateWithMergeRegion/252a1ea38016c2dfc1f1109b2d0063b5/cf 2023-07-23 10:07:23,782 DEBUG [StoreOpener-0b562e5c83406565c5384eccba86910a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemStateWithMergeRegion/0b562e5c83406565c5384eccba86910a/cf 2023-07-23 10:07:23,782 DEBUG [StoreOpener-0b562e5c83406565c5384eccba86910a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemStateWithMergeRegion/0b562e5c83406565c5384eccba86910a/cf 2023-07-23 10:07:23,783 INFO [StoreOpener-252a1ea38016c2dfc1f1109b2d0063b5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 252a1ea38016c2dfc1f1109b2d0063b5 columnFamilyName cf 2023-07-23 10:07:23,783 INFO [StoreOpener-0b562e5c83406565c5384eccba86910a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0b562e5c83406565c5384eccba86910a columnFamilyName cf 2023-07-23 10:07:23,784 INFO [StoreOpener-252a1ea38016c2dfc1f1109b2d0063b5-1] regionserver.HStore(310): Store=252a1ea38016c2dfc1f1109b2d0063b5/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 10:07:23,784 INFO [StoreOpener-0b562e5c83406565c5384eccba86910a-1] regionserver.HStore(310): Store=0b562e5c83406565c5384eccba86910a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 10:07:23,785 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemStateWithMergeRegion/252a1ea38016c2dfc1f1109b2d0063b5 2023-07-23 10:07:23,786 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemStateWithMergeRegion/0b562e5c83406565c5384eccba86910a 2023-07-23 10:07:23,786 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemStateWithMergeRegion/252a1ea38016c2dfc1f1109b2d0063b5 2023-07-23 10:07:23,786 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemStateWithMergeRegion/0b562e5c83406565c5384eccba86910a 2023-07-23 10:07:23,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0b562e5c83406565c5384eccba86910a 2023-07-23 10:07:23,791 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemStateWithMergeRegion/0b562e5c83406565c5384eccba86910a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 10:07:23,792 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0b562e5c83406565c5384eccba86910a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63013333, jitterRate=-0.061028167605400085}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 10:07:23,792 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0b562e5c83406565c5384eccba86910a: 2023-07-23 10:07:23,792 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 252a1ea38016c2dfc1f1109b2d0063b5 2023-07-23 10:07:23,793 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1690106843408.0b562e5c83406565c5384eccba86910a., pid=61, masterSystemTime=1690106843776 2023-07-23 10:07:23,794 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemStateWithMergeRegion/252a1ea38016c2dfc1f1109b2d0063b5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 10:07:23,795 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 252a1ea38016c2dfc1f1109b2d0063b5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63046741, jitterRate=-0.06053034961223602}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 10:07:23,795 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 252a1ea38016c2dfc1f1109b2d0063b5: 2023-07-23 10:07:23,795 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1690106843408.0b562e5c83406565c5384eccba86910a. 2023-07-23 10:07:23,795 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1690106843408.0b562e5c83406565c5384eccba86910a. 2023-07-23 10:07:23,795 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1690106843408.252a1ea38016c2dfc1f1109b2d0063b5., pid=60, masterSystemTime=1690106843771 2023-07-23 10:07:23,796 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=0b562e5c83406565c5384eccba86910a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:07:23,796 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690106843408.0b562e5c83406565c5384eccba86910a.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690106843796"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690106843796"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690106843796"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690106843796"}]},"ts":"1690106843796"} 2023-07-23 10:07:23,798 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1690106843408.252a1ea38016c2dfc1f1109b2d0063b5. 2023-07-23 10:07:23,798 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1690106843408.252a1ea38016c2dfc1f1109b2d0063b5. 2023-07-23 10:07:23,798 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=252a1ea38016c2dfc1f1109b2d0063b5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:07:23,798 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690106843408.252a1ea38016c2dfc1f1109b2d0063b5.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690106843798"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690106843798"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690106843798"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690106843798"}]},"ts":"1690106843798"} 2023-07-23 10:07:23,801 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=59 2023-07-23 10:07:23,801 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=59, state=SUCCESS; OpenRegionProcedure 0b562e5c83406565c5384eccba86910a, server=jenkins-hbase4.apache.org,36827,1690106767853 in 177 msec 2023-07-23 10:07:23,802 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=58 2023-07-23 10:07:23,802 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=58, state=SUCCESS; OpenRegionProcedure 252a1ea38016c2dfc1f1109b2d0063b5, server=jenkins-hbase4.apache.org,36599,1690106767729 in 181 msec 2023-07-23 10:07:23,803 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0b562e5c83406565c5384eccba86910a, ASSIGN in 340 msec 2023-07-23 10:07:23,804 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=58, resume processing ppid=57 2023-07-23 10:07:23,804 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=252a1ea38016c2dfc1f1109b2d0063b5, ASSIGN in 341 msec 2023-07-23 10:07:23,805 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-23 10:07:23,805 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690106843805"}]},"ts":"1690106843805"} 2023-07-23 10:07:23,806 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-23 10:07:23,810 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-23 10:07:23,810 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-23 10:07:23,812 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39563] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-23 10:07:23,813 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:07:23,813 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:07:23,813 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:07:23,814 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:07:23,815 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-23 10:07:23,815 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:23,815 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-23 10:07:23,815 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-23 10:07:23,816 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-23 10:07:23,817 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 407 msec 2023-07-23 10:07:24,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-23 10:07:24,017 INFO [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-23 10:07:24,019 DEBUG [Listener at jenkins-hbase4.apache.org/44565] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,019 DEBUG [Listener at jenkins-hbase4.apache.org/44565] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1690106843408.252a1ea38016c2dfc1f1109b2d0063b5. 2023-07-23 10:07:24,021 INFO [Listener at jenkins-hbase4.apache.org/44565] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 10:07:24,033 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-23 10:07:24,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690106844033 (current time:1690106844033). 2023-07-23 10:07:24,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-23 10:07:24,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] zookeeper.ReadOnlyZKClient(139): Connect 0x166e78ca to 127.0.0.1:55181 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 10:07:24,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@23359d08, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 10:07:24,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 10:07:24,045 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56690, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 10:07:24,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x166e78ca to 127.0.0.1:55181 2023-07-23 10:07:24,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 10:07:24,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] zookeeper.ReadOnlyZKClient(139): Connect 0x4d5c79d3 to 127.0.0.1:55181 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 10:07:24,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2811f09a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 10:07:24,053 DEBUG [hconnection-0x2743e54d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 10:07:24,056 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56702, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 10:07:24,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4d5c79d3 to 127.0.0.1:55181 2023-07-23 10:07:24,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 10:07:24,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-23 10:07:24,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-23 10:07:24,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-23 10:07:24,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-23 10:07:24,064 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-23 10:07:24,065 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1690107444065 2023-07-23 10:07:24,065 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-23 10:07:24,066 DEBUG [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-23 10:07:24,067 DEBUG [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-23 10:07:24,067 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-23 10:07:24,068 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-23 10:07:24,069 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 6 msec 2023-07-23 10:07:24,070 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-23 10:07:24,071 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1690107444071 2023-07-23 10:07:24,086 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,086 INFO [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-23 10:07:24,086 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:07:24,088 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-23 10:07:24,088 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-23 10:07:24,088 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,088 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,089 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:07:24,089 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:07:24,089 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:07:24,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:07:24,089 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:07:24,089 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:07:24,090 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:07:24,090 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:07:24,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:07:24,090 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:07:24,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:07:24,090 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:07:24,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,090 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,090 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:07:24,090 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-23 10:07:24,091 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-23 10:07:24,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,091 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,091 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-23 10:07:24,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-23 10:07:24,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,091 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-23 10:07:24,091 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-23 10:07:24,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,091 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:07:24,091 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-23 10:07:24,092 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-23 10:07:24,092 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-23 10:07:24,092 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-23 10:07:24,092 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36827,1690106767853' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-23 10:07:24,093 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,093 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-23 10:07:24,093 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,093 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:07:24,093 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-23 10:07:24,094 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-23 10:07:24,094 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-23 10:07:24,094 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:07:24,094 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36599,1690106767729' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-23 10:07:24,095 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-23 10:07:24,095 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-23 10:07:24,095 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39563,1690106767800' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-23 10:07:24,097 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:07:24,097 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:07:24,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:07:24,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:07:24,098 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:07:24,098 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,098 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,098 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 10:07:24,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:07:24,098 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,098 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,098 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 10:07:24,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:07:24,098 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,098 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 10:07:24,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:07:24,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:07:24,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:07:24,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:07:24,100 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36827,1690106767853' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-23 10:07:24,100 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7400b36a[Count = 1] remaining members to acquire global barrier 2023-07-23 10:07:24,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:07:24,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:07:24,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:07:24,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:07:24,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:07:24,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:07:24,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:07:24,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:07:24,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:07:24,102 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36599,1690106767729' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-23 10:07:24,102 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7400b36a[Count = 0] remaining members to acquire global barrier 2023-07-23 10:07:24,102 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-23 10:07:24,102 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,103 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,103 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,103 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,104 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-23 10:07:24,104 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:07:24,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,104 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-23 10:07:24,104 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 10:07:24,104 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 10:07:24,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,104 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:07:24,104 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-23 10:07:24,104 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-23 10:07:24,104 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 10:07:24,104 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 10:07:24,104 DEBUG [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1690106843408.252a1ea38016c2dfc1f1109b2d0063b5. 2023-07-23 10:07:24,104 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-23 10:07:24,104 DEBUG [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1690106843408.0b562e5c83406565c5384eccba86910a. 2023-07-23 10:07:24,104 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,39563,1690106767800' in zk 2023-07-23 10:07:24,104 DEBUG [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1690106843408.252a1ea38016c2dfc1f1109b2d0063b5. started... 2023-07-23 10:07:24,104 DEBUG [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1690106843408.0b562e5c83406565c5384eccba86910a. started... 2023-07-23 10:07:24,106 DEBUG [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0b562e5c83406565c5384eccba86910a: 2023-07-23 10:07:24,106 DEBUG [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 252a1ea38016c2dfc1f1109b2d0063b5: 2023-07-23 10:07:24,106 DEBUG [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1690106843408.0b562e5c83406565c5384eccba86910a.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,106 DEBUG [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1690106843408.252a1ea38016c2dfc1f1109b2d0063b5.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,106 DEBUG [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 10:07:24,106 DEBUG [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 10:07:24,106 DEBUG [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-23 10:07:24,106 DEBUG [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-23 10:07:24,117 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-23 10:07:24,117 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:07:24,117 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-23 10:07:24,124 DEBUG [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1690106843408.0b562e5c83406565c5384eccba86910a. completed. 2023-07-23 10:07:24,124 DEBUG [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1690106843408.0b562e5c83406565c5384eccba86910a. 2023-07-23 10:07:24,124 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 10:07:24,124 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 10:07:24,124 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:07:24,124 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-23 10:07:24,124 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,36827,1690106767853' in zk 2023-07-23 10:07:24,126 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-23 10:07:24,126 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:07:24,126 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:07:24,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:07:24,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:07:24,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:07:24,126 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-23 10:07:24,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:07:24,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:07:24,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:07:24,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:07:24,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:07:24,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:07:24,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:07:24,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:07:24,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,36827,1690106767853': 2023-07-23 10:07:24,130 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36827,1690106767853' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-23 10:07:24,167 DEBUG [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 10:07:24,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-23 10:07:24,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-23 10:07:24,168 DEBUG [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-23 10:07:24,368 DEBUG [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 10:07:24,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-23 10:07:24,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-23 10:07:24,369 DEBUG [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-23 10:07:24,524 DEBUG [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1690106843408.252a1ea38016c2dfc1f1109b2d0063b5. completed. 2023-07-23 10:07:24,524 DEBUG [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1690106843408.252a1ea38016c2dfc1f1109b2d0063b5. 2023-07-23 10:07:24,524 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 10:07:24,525 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 10:07:24,525 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:07:24,525 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-23 10:07:24,525 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,36599,1690106767729' in zk 2023-07-23 10:07:24,526 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:07:24,526 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-23 10:07:24,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:07:24,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:07:24,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:07:24,527 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:07:24,527 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-23 10:07:24,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:07:24,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:07:24,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:07:24,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:07:24,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:07:24,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:07:24,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:07:24,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:07:24,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:07:24,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,36599,1690106767729': 2023-07-23 10:07:24,532 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36599,1690106767729' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-23 10:07:24,532 INFO [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-23 10:07:24,532 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-23 10:07:24,532 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-23 10:07:24,532 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,532 INFO [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-23 10:07:24,534 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,534 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,534 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,534 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,534 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,534 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,534 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,534 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:07:24,534 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:07:24,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:07:24,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:07:24,534 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:07:24,535 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:07:24,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:07:24,535 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:07:24,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,535 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:07:24,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:07:24,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:07:24,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,535 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:07:24,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,536 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:07:24,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:07:24,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,536 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:07:24,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:07:24,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:07:24,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:07:24,538 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:07:24,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:07:24,538 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:07:24,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:07:24,539 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:07:24,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:07:24,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:07:24,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:07:24,543 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:07:24,543 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,543 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:07:24,543 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:07:24,543 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:07:24,543 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:07:24,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:07:24,543 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:07:24,543 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:07:24,543 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:07:24,543 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:07:24,543 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:07:24,543 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,545 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:07:24,545 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:07:24,545 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,543 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:07:24,546 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-23 10:07:24,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:07:24,543 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:07:24,543 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,546 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:07:24,546 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:07:24,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:07:24,546 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:07:24,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:07:24,546 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,546 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:07:24,546 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:07:24,546 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,546 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,546 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-23 10:07:24,546 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:07:24,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:07:24,560 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,560 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,613 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,636 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-23 10:07:24,636 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,637 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,637 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1690106844065Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1690106844560 (+495 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1690106844560Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1690106844560Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1690106844572 (+12 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1690106844600 (+28 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1690106844636 (+36 ms) 2023-07-23 10:07:24,639 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-23 10:07:24,641 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 573 msec 2023-07-23 10:07:24,670 DEBUG [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 10:07:24,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-23 10:07:24,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-23 10:07:24,673 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36599] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1690106843408.252a1ea38016c2dfc1f1109b2d0063b5. with WAL disabled. Data may be lost in the event of a crash. 2023-07-23 10:07:24,675 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36827] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1690106843408.0b562e5c83406565c5384eccba86910a. with WAL disabled. Data may be lost in the event of a crash. 2023-07-23 10:07:24,678 DEBUG [Listener at jenkins-hbase4.apache.org/44565] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,678 DEBUG [Listener at jenkins-hbase4.apache.org/44565] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1690106843408.252a1ea38016c2dfc1f1109b2d0063b5. 2023-07-23 10:07:24,678 INFO [Listener at jenkins-hbase4.apache.org/44565] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 10:07:24,689 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-23 10:07:24,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690106844689 (current time:1690106844689). 2023-07-23 10:07:24,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-23 10:07:24,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] zookeeper.ReadOnlyZKClient(139): Connect 0x7b713269 to 127.0.0.1:55181 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 10:07:24,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4109e298, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 10:07:24,698 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 10:07:24,699 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56710, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 10:07:24,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7b713269 to 127.0.0.1:55181 2023-07-23 10:07:24,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 10:07:24,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] zookeeper.ReadOnlyZKClient(139): Connect 0x73c07ea2 to 127.0.0.1:55181 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 10:07:24,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1d0e8c9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 10:07:24,709 DEBUG [hconnection-0xf43c749-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 10:07:24,711 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56722, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 10:07:24,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x73c07ea2 to 127.0.0.1:55181 2023-07-23 10:07:24,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 10:07:24,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-23 10:07:24,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-23 10:07:24,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-23 10:07:24,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-23 10:07:24,720 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-23 10:07:24,720 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1690107444720 2023-07-23 10:07:24,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-23 10:07:24,720 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,722 DEBUG [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-23 10:07:24,722 DEBUG [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-23 10:07:24,723 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-23 10:07:24,723 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-23 10:07:24,724 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-07-23 10:07:24,724 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-23 10:07:24,725 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1690107444725 2023-07-23 10:07:24,734 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,734 INFO [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-23 10:07:24,734 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:07:24,735 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-23 10:07:24,735 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-23 10:07:24,735 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,735 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,737 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:07:24,737 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:07:24,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:07:24,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:07:24,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:07:24,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:07:24,737 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:07:24,737 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:07:24,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:07:24,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:07:24,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,737 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:07:24,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,737 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:07:24,738 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,738 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,738 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-23 10:07:24,738 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:07:24,738 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-23 10:07:24,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-23 10:07:24,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-23 10:07:24,738 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-23 10:07:24,738 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-23 10:07:24,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,739 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,739 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-23 10:07:24,739 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-23 10:07:24,739 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,739 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:07:24,739 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-23 10:07:24,740 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,740 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-23 10:07:24,740 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-23 10:07:24,740 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:07:24,740 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:07:24,741 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-23 10:07:24,742 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-23 10:07:24,740 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-23 10:07:24,742 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39563,1690106767800' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-23 10:07:24,742 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-23 10:07:24,742 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36599,1690106767729' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-23 10:07:24,742 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-23 10:07:24,743 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36827,1690106767853' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-23 10:07:24,744 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:07:24,744 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:07:24,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:07:24,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:07:24,746 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,746 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,746 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 10:07:24,746 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,746 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,746 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 10:07:24,747 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,747 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 10:07:24,747 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:07:24,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:07:24,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:07:24,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:07:24,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:07:24,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:07:24,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:07:24,749 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36599,1690106767729' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-23 10:07:24,749 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@39e2c976[Count = 1] remaining members to acquire global barrier 2023-07-23 10:07:24,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:07:24,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:07:24,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:07:24,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:07:24,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:07:24,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:07:24,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:07:24,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:07:24,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:07:24,752 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36827,1690106767853' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-23 10:07:24,752 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@39e2c976[Count = 0] remaining members to acquire global barrier 2023-07-23 10:07:24,752 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-23 10:07:24,752 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,753 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,753 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,753 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,753 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,753 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,753 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-23 10:07:24,753 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,753 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:07:24,753 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-23 10:07:24,753 DEBUG [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1690106843408.252a1ea38016c2dfc1f1109b2d0063b5. 2023-07-23 10:07:24,753 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-23 10:07:24,753 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 10:07:24,754 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:07:24,754 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-23 10:07:24,754 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 10:07:24,754 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 10:07:24,754 DEBUG [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1690106843408.0b562e5c83406565c5384eccba86910a. 2023-07-23 10:07:24,754 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 10:07:24,754 DEBUG [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1690106843408.252a1ea38016c2dfc1f1109b2d0063b5. started... 2023-07-23 10:07:24,753 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-23 10:07:24,754 DEBUG [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1690106843408.0b562e5c83406565c5384eccba86910a. started... 2023-07-23 10:07:24,754 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,39563,1690106767800' in zk 2023-07-23 10:07:24,754 INFO [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 252a1ea38016c2dfc1f1109b2d0063b5 1/1 column families, dataSize=400 B heapSize=1.09 KB 2023-07-23 10:07:24,754 INFO [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 0b562e5c83406565c5384eccba86910a 1/1 column families, dataSize=2.87 KB heapSize=6.44 KB 2023-07-23 10:07:24,756 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-23 10:07:24,756 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:07:24,756 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-23 10:07:24,788 INFO [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023072364d242d9cc6443d98cf73421f327d99d to hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e2023072364d242d9cc6443d98cf73421f327d99d 2023-07-23 10:07:24,800 INFO [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=400, hasBloomFilter=true, into tmp file hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemStateWithMergeRegion/252a1ea38016c2dfc1f1109b2d0063b5/.tmp/cf/6b949ca8746140dc942adc3e567416f7 2023-07-23 10:07:24,807 DEBUG [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemStateWithMergeRegion/252a1ea38016c2dfc1f1109b2d0063b5/.tmp/cf/6b949ca8746140dc942adc3e567416f7 as hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemStateWithMergeRegion/252a1ea38016c2dfc1f1109b2d0063b5/cf/6b949ca8746140dc942adc3e567416f7 2023-07-23 10:07:24,812 INFO [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemStateWithMergeRegion/252a1ea38016c2dfc1f1109b2d0063b5/cf/6b949ca8746140dc942adc3e567416f7, entries=6, sequenceid=6, filesize=6.0 K 2023-07-23 10:07:24,813 INFO [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~400 B/400, heapSize ~1.08 KB/1104, currentSize=0 B/0 for 252a1ea38016c2dfc1f1109b2d0063b5 in 59ms, sequenceid=6, compaction requested=false 2023-07-23 10:07:24,813 DEBUG [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-23 10:07:24,814 DEBUG [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 252a1ea38016c2dfc1f1109b2d0063b5: 2023-07-23 10:07:24,814 DEBUG [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1690106843408.252a1ea38016c2dfc1f1109b2d0063b5.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,814 DEBUG [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 10:07:24,814 DEBUG [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemStateWithMergeRegion/252a1ea38016c2dfc1f1109b2d0063b5/cf/6b949ca8746140dc942adc3e567416f7] hfiles 2023-07-23 10:07:24,814 DEBUG [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemStateWithMergeRegion/252a1ea38016c2dfc1f1109b2d0063b5/cf/6b949ca8746140dc942adc3e567416f7 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,821 DEBUG [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1690106843408.252a1ea38016c2dfc1f1109b2d0063b5. completed. 2023-07-23 10:07:24,821 DEBUG [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1690106843408.252a1ea38016c2dfc1f1109b2d0063b5. 2023-07-23 10:07:24,821 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 10:07:24,821 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 10:07:24,821 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:07:24,821 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-23 10:07:24,821 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,36599,1690106767729' in zk 2023-07-23 10:07:24,822 DEBUG [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 10:07:24,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-23 10:07:24,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-23 10:07:24,823 DEBUG [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-23 10:07:24,823 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:07:24,823 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-23 10:07:24,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:07:24,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:07:24,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:07:24,823 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:07:24,824 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-23 10:07:24,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:07:24,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:07:24,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:07:24,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:07:24,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:07:24,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:07:24,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:24,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:07:24,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:07:24,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,36599,1690106767729': 2023-07-23 10:07:24,829 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36599,1690106767729' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-23 10:07:25,023 DEBUG [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 10:07:25,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-23 10:07:25,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-23 10:07:25,024 DEBUG [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-23 10:07:25,190 INFO [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307235f6d2a5692974e838fede939889ef523 to hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202307235f6d2a5692974e838fede939889ef523 2023-07-23 10:07:25,198 INFO [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemStateWithMergeRegion/0b562e5c83406565c5384eccba86910a/.tmp/cf/acaf9ec2a915487da467809a28cbb94f 2023-07-23 10:07:25,203 DEBUG [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemStateWithMergeRegion/0b562e5c83406565c5384eccba86910a/.tmp/cf/acaf9ec2a915487da467809a28cbb94f as hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemStateWithMergeRegion/0b562e5c83406565c5384eccba86910a/cf/acaf9ec2a915487da467809a28cbb94f 2023-07-23 10:07:25,209 INFO [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemStateWithMergeRegion/0b562e5c83406565c5384eccba86910a/cf/acaf9ec2a915487da467809a28cbb94f, entries=44, sequenceid=6, filesize=13.0 K 2023-07-23 10:07:25,210 INFO [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.87 KB/2936, heapSize ~6.42 KB/6576, currentSize=0 B/0 for 0b562e5c83406565c5384eccba86910a in 456ms, sequenceid=6, compaction requested=false 2023-07-23 10:07:25,212 DEBUG [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0b562e5c83406565c5384eccba86910a: 2023-07-23 10:07:25,212 DEBUG [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1690106843408.0b562e5c83406565c5384eccba86910a.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,212 DEBUG [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 10:07:25,212 DEBUG [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemStateWithMergeRegion/0b562e5c83406565c5384eccba86910a/cf/acaf9ec2a915487da467809a28cbb94f] hfiles 2023-07-23 10:07:25,212 DEBUG [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemStateWithMergeRegion/0b562e5c83406565c5384eccba86910a/cf/acaf9ec2a915487da467809a28cbb94f for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,219 DEBUG [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1690106843408.0b562e5c83406565c5384eccba86910a. completed. 2023-07-23 10:07:25,219 DEBUG [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1690106843408.0b562e5c83406565c5384eccba86910a. 2023-07-23 10:07:25,219 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 10:07:25,219 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 10:07:25,219 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:07:25,219 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-23 10:07:25,219 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,36827,1690106767853' in zk 2023-07-23 10:07:25,221 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:07:25,221 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-23 10:07:25,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:07:25,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:07:25,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:07:25,221 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:07:25,221 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-23 10:07:25,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:07:25,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:07:25,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:07:25,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:07:25,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:07:25,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:07:25,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:07:25,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:07:25,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:07:25,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,36827,1690106767853': 2023-07-23 10:07:25,227 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36827,1690106767853' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-23 10:07:25,227 INFO [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-23 10:07:25,227 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-23 10:07:25,227 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-23 10:07:25,227 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,227 INFO [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-23 10:07:25,234 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,234 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,234 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:07:25,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:07:25,234 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:07:25,234 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,234 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,234 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,234 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:07:25,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:07:25,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,234 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:07:25,234 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,234 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:07:25,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,235 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:07:25,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:07:25,235 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:07:25,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:07:25,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,235 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:07:25,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,235 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:07:25,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:07:25,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:07:25,235 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:07:25,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:07:25,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:07:25,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:07:25,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:07:25,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,237 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:07:25,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:07:25,238 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:07:25,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:07:25,238 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:07:25,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:07:25,241 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:07:25,241 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,241 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:07:25,241 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:07:25,241 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:07:25,241 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:07:25,241 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:07:25,241 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:07:25,241 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:07:25,241 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:07:25,241 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:07:25,243 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,243 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,243 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:07:25,243 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,243 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:07:25,243 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-23 10:07:25,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:07:25,243 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:07:25,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:07:25,243 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:07:25,243 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:07:25,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:07:25,243 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:07:25,244 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,244 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:07:25,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:07:25,244 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:07:25,244 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:07:25,244 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,244 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,244 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:07:25,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:07:25,244 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202307235f6d2a5692974e838fede939889ef523, hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e2023072364d242d9cc6443d98cf73421f327d99d] mob files 2023-07-23 10:07:25,244 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202307235f6d2a5692974e838fede939889ef523 2023-07-23 10:07:25,245 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e2023072364d242d9cc6443d98cf73421f327d99d 2023-07-23 10:07:25,253 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,254 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,276 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,306 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-23 10:07:25,306 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,306 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:25,306 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1690106844721Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1690106845253 (+532 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1690106845253Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1690106845253Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1690106845257 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1690106845268 (+11 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1690106845306 (+38 ms) 2023-07-23 10:07:25,309 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-23 10:07:25,311 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 588 msec 2023-07-23 10:07:25,325 DEBUG [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 10:07:25,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-23 10:07:25,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-23 10:07:25,360 DEBUG [Listener at jenkins-hbase4.apache.org/44565] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-23 10:07:25,364 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47410, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-23 10:07:25,365 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36599] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-23 10:07:25,366 DEBUG [Listener at jenkins-hbase4.apache.org/44565] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-23 10:07:25,371 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42904, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-23 10:07:25,371 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36827] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-23 10:07:25,371 DEBUG [Listener at jenkins-hbase4.apache.org/44565] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-23 10:07:25,375 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56736, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-23 10:07:25,375 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39563] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-23 10:07:25,378 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-23 10:07:25,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:25,383 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-23 10:07:25,383 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-23 10:07:25,383 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-23 10:07:25,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-23 10:07:25,386 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/57e8a642a49f9c933b55756e738bc864 2023-07-23 10:07:25,386 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f763da838d17186aea3ca317c998be82 2023-07-23 10:07:25,387 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f763da838d17186aea3ca317c998be82 empty. 2023-07-23 10:07:25,387 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/57e8a642a49f9c933b55756e738bc864 empty. 2023-07-23 10:07:25,387 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f763da838d17186aea3ca317c998be82 2023-07-23 10:07:25,387 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/57e8a642a49f9c933b55756e738bc864 2023-07-23 10:07:25,387 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-23 10:07:25,399 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-23 10:07:25,401 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => f763da838d17186aea3ca317c998be82, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1690106845377.f763da838d17186aea3ca317c998be82.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp 2023-07-23 10:07:25,401 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 57e8a642a49f9c933b55756e738bc864, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690106845377.57e8a642a49f9c933b55756e738bc864.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp 2023-07-23 10:07:25,412 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1690106845377.f763da838d17186aea3ca317c998be82.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 10:07:25,412 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing f763da838d17186aea3ca317c998be82, disabling compactions & flushes 2023-07-23 10:07:25,413 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1690106845377.f763da838d17186aea3ca317c998be82. 2023-07-23 10:07:25,413 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1690106845377.f763da838d17186aea3ca317c998be82. 2023-07-23 10:07:25,413 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1690106845377.57e8a642a49f9c933b55756e738bc864.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 10:07:25,413 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1690106845377.f763da838d17186aea3ca317c998be82. after waiting 0 ms 2023-07-23 10:07:25,413 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 57e8a642a49f9c933b55756e738bc864, disabling compactions & flushes 2023-07-23 10:07:25,413 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1690106845377.f763da838d17186aea3ca317c998be82. 2023-07-23 10:07:25,413 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1690106845377.57e8a642a49f9c933b55756e738bc864. 2023-07-23 10:07:25,413 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1690106845377.f763da838d17186aea3ca317c998be82. 2023-07-23 10:07:25,413 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690106845377.57e8a642a49f9c933b55756e738bc864. 2023-07-23 10:07:25,413 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690106845377.57e8a642a49f9c933b55756e738bc864. after waiting 0 ms 2023-07-23 10:07:25,413 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1690106845377.57e8a642a49f9c933b55756e738bc864. 2023-07-23 10:07:25,413 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for f763da838d17186aea3ca317c998be82: 2023-07-23 10:07:25,413 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1690106845377.57e8a642a49f9c933b55756e738bc864. 2023-07-23 10:07:25,413 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 57e8a642a49f9c933b55756e738bc864: 2023-07-23 10:07:25,415 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-23 10:07:25,416 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690106845377.f763da838d17186aea3ca317c998be82.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690106845416"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690106845416"}]},"ts":"1690106845416"} 2023-07-23 10:07:25,416 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690106845377.57e8a642a49f9c933b55756e738bc864.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690106845416"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690106845416"}]},"ts":"1690106845416"} 2023-07-23 10:07:25,418 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-23 10:07:25,419 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-23 10:07:25,419 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690106845419"}]},"ts":"1690106845419"} 2023-07-23 10:07:25,420 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-23 10:07:25,423 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-23 10:07:25,424 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-23 10:07:25,424 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-23 10:07:25,424 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-23 10:07:25,424 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-23 10:07:25,425 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=57e8a642a49f9c933b55756e738bc864, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f763da838d17186aea3ca317c998be82, ASSIGN}] 2023-07-23 10:07:25,427 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f763da838d17186aea3ca317c998be82, ASSIGN 2023-07-23 10:07:25,427 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=57e8a642a49f9c933b55756e738bc864, ASSIGN 2023-07-23 10:07:25,428 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f763da838d17186aea3ca317c998be82, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36827,1690106767853; forceNewPlan=false, retain=false 2023-07-23 10:07:25,428 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=57e8a642a49f9c933b55756e738bc864, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39563,1690106767800; forceNewPlan=false, retain=false 2023-07-23 10:07:25,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-23 10:07:25,578 INFO [jenkins-hbase4:34097] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-23 10:07:25,581 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=57e8a642a49f9c933b55756e738bc864, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:07:25,581 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=f763da838d17186aea3ca317c998be82, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:07:25,582 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690106845377.57e8a642a49f9c933b55756e738bc864.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690106845581"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690106845581"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690106845581"}]},"ts":"1690106845581"} 2023-07-23 10:07:25,582 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690106845377.f763da838d17186aea3ca317c998be82.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690106845581"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690106845581"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690106845581"}]},"ts":"1690106845581"} 2023-07-23 10:07:25,584 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 57e8a642a49f9c933b55756e738bc864, server=jenkins-hbase4.apache.org,39563,1690106767800}] 2023-07-23 10:07:25,585 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=68, state=RUNNABLE; OpenRegionProcedure f763da838d17186aea3ca317c998be82, server=jenkins-hbase4.apache.org,36827,1690106767853}] 2023-07-23 10:07:25,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-23 10:07:25,753 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1690106845377.f763da838d17186aea3ca317c998be82. 2023-07-23 10:07:25,753 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f763da838d17186aea3ca317c998be82, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1690106845377.f763da838d17186aea3ca317c998be82.', STARTKEY => '2', ENDKEY => ''} 2023-07-23 10:07:25,754 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1690106845377.f763da838d17186aea3ca317c998be82. service=AccessControlService 2023-07-23 10:07:25,754 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1690106845377.57e8a642a49f9c933b55756e738bc864. 2023-07-23 10:07:25,754 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 10:07:25,754 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 57e8a642a49f9c933b55756e738bc864, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690106845377.57e8a642a49f9c933b55756e738bc864.', STARTKEY => '', ENDKEY => '2'} 2023-07-23 10:07:25,754 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 f763da838d17186aea3ca317c998be82 2023-07-23 10:07:25,754 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1690106845377.f763da838d17186aea3ca317c998be82.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 10:07:25,755 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f763da838d17186aea3ca317c998be82 2023-07-23 10:07:25,755 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1690106845377.57e8a642a49f9c933b55756e738bc864. service=AccessControlService 2023-07-23 10:07:25,755 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 10:07:25,755 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 57e8a642a49f9c933b55756e738bc864 2023-07-23 10:07:25,755 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1690106845377.57e8a642a49f9c933b55756e738bc864.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 10:07:25,755 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 57e8a642a49f9c933b55756e738bc864 2023-07-23 10:07:25,755 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 57e8a642a49f9c933b55756e738bc864 2023-07-23 10:07:25,755 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f763da838d17186aea3ca317c998be82 2023-07-23 10:07:25,757 INFO [StoreOpener-57e8a642a49f9c933b55756e738bc864-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 57e8a642a49f9c933b55756e738bc864 2023-07-23 10:07:25,761 DEBUG [StoreOpener-57e8a642a49f9c933b55756e738bc864-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/57e8a642a49f9c933b55756e738bc864/cf 2023-07-23 10:07:25,761 DEBUG [StoreOpener-57e8a642a49f9c933b55756e738bc864-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/57e8a642a49f9c933b55756e738bc864/cf 2023-07-23 10:07:25,762 INFO [StoreOpener-57e8a642a49f9c933b55756e738bc864-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 57e8a642a49f9c933b55756e738bc864 columnFamilyName cf 2023-07-23 10:07:25,763 INFO [StoreOpener-57e8a642a49f9c933b55756e738bc864-1] regionserver.HStore(310): Store=57e8a642a49f9c933b55756e738bc864/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 10:07:25,764 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/57e8a642a49f9c933b55756e738bc864 2023-07-23 10:07:25,764 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/57e8a642a49f9c933b55756e738bc864 2023-07-23 10:07:25,768 INFO [StoreOpener-f763da838d17186aea3ca317c998be82-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f763da838d17186aea3ca317c998be82 2023-07-23 10:07:25,770 DEBUG [StoreOpener-f763da838d17186aea3ca317c998be82-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f763da838d17186aea3ca317c998be82/cf 2023-07-23 10:07:25,770 DEBUG [StoreOpener-f763da838d17186aea3ca317c998be82-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f763da838d17186aea3ca317c998be82/cf 2023-07-23 10:07:25,771 INFO [StoreOpener-f763da838d17186aea3ca317c998be82-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f763da838d17186aea3ca317c998be82 columnFamilyName cf 2023-07-23 10:07:25,771 INFO [StoreOpener-f763da838d17186aea3ca317c998be82-1] regionserver.HStore(310): Store=f763da838d17186aea3ca317c998be82/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 10:07:25,772 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 57e8a642a49f9c933b55756e738bc864 2023-07-23 10:07:25,772 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f763da838d17186aea3ca317c998be82 2023-07-23 10:07:25,773 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f763da838d17186aea3ca317c998be82 2023-07-23 10:07:25,774 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/57e8a642a49f9c933b55756e738bc864/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 10:07:25,775 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 57e8a642a49f9c933b55756e738bc864; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70097769, jitterRate=0.04453815519809723}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 10:07:25,775 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 57e8a642a49f9c933b55756e738bc864: 2023-07-23 10:07:25,776 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f763da838d17186aea3ca317c998be82 2023-07-23 10:07:25,778 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1690106845377.57e8a642a49f9c933b55756e738bc864., pid=69, masterSystemTime=1690106845746 2023-07-23 10:07:25,778 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f763da838d17186aea3ca317c998be82/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 10:07:25,779 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f763da838d17186aea3ca317c998be82; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70429030, jitterRate=0.0494743287563324}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 10:07:25,779 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f763da838d17186aea3ca317c998be82: 2023-07-23 10:07:25,780 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1690106845377.f763da838d17186aea3ca317c998be82., pid=70, masterSystemTime=1690106845747 2023-07-23 10:07:25,781 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1690106845377.57e8a642a49f9c933b55756e738bc864. 2023-07-23 10:07:25,781 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1690106845377.57e8a642a49f9c933b55756e738bc864. 2023-07-23 10:07:25,781 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=57e8a642a49f9c933b55756e738bc864, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:07:25,781 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690106845377.57e8a642a49f9c933b55756e738bc864.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690106845781"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690106845781"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690106845781"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690106845781"}]},"ts":"1690106845781"} 2023-07-23 10:07:25,781 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1690106845377.f763da838d17186aea3ca317c998be82. 2023-07-23 10:07:25,782 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1690106845377.f763da838d17186aea3ca317c998be82. 2023-07-23 10:07:25,782 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=f763da838d17186aea3ca317c998be82, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:07:25,782 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690106845377.f763da838d17186aea3ca317c998be82.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690106845782"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690106845782"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690106845782"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690106845782"}]},"ts":"1690106845782"} 2023-07-23 10:07:25,793 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=67 2023-07-23 10:07:25,793 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 57e8a642a49f9c933b55756e738bc864, server=jenkins-hbase4.apache.org,39563,1690106767800 in 200 msec 2023-07-23 10:07:25,795 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=68 2023-07-23 10:07:25,795 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=57e8a642a49f9c933b55756e738bc864, ASSIGN in 369 msec 2023-07-23 10:07:25,795 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=68, state=SUCCESS; OpenRegionProcedure f763da838d17186aea3ca317c998be82, server=jenkins-hbase4.apache.org,36827,1690106767853 in 207 msec 2023-07-23 10:07:25,798 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=68, resume processing ppid=66 2023-07-23 10:07:25,798 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f763da838d17186aea3ca317c998be82, ASSIGN in 371 msec 2023-07-23 10:07:25,799 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-23 10:07:25,799 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690106845799"}]},"ts":"1690106845799"} 2023-07-23 10:07:25,803 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-23 10:07:25,806 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-23 10:07:25,806 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-23 10:07:25,816 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39563] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-23 10:07:25,819 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:07:25,819 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:07:25,819 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:07:25,819 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:07:25,821 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-23 10:07:25,822 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-23 10:07:25,822 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-23 10:07:25,822 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-23 10:07:25,822 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-23 10:07:25,823 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-23 10:07:25,822 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-23 10:07:25,823 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-23 10:07:25,825 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 445 msec 2023-07-23 10:07:25,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-23 10:07:25,989 INFO [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-23 10:07:26,015 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions 57e8a642a49f9c933b55756e738bc864, f763da838d17186aea3ca317c998be82 2023-07-23 10:07:26,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[57e8a642a49f9c933b55756e738bc864, f763da838d17186aea3ca317c998be82], force=true 2023-07-23 10:07:26,029 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[57e8a642a49f9c933b55756e738bc864, f763da838d17186aea3ca317c998be82], force=true 2023-07-23 10:07:26,029 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[57e8a642a49f9c933b55756e738bc864, f763da838d17186aea3ca317c998be82], force=true 2023-07-23 10:07:26,029 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[57e8a642a49f9c933b55756e738bc864, f763da838d17186aea3ca317c998be82], force=true 2023-07-23 10:07:26,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-23 10:07:26,058 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=57e8a642a49f9c933b55756e738bc864, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f763da838d17186aea3ca317c998be82, UNASSIGN}] 2023-07-23 10:07:26,066 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=57e8a642a49f9c933b55756e738bc864, UNASSIGN 2023-07-23 10:07:26,066 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f763da838d17186aea3ca317c998be82, UNASSIGN 2023-07-23 10:07:26,067 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=f763da838d17186aea3ca317c998be82, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:07:26,068 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=57e8a642a49f9c933b55756e738bc864, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:07:26,068 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690106845377.f763da838d17186aea3ca317c998be82.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690106846067"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690106846067"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690106846067"}]},"ts":"1690106846067"} 2023-07-23 10:07:26,068 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690106845377.57e8a642a49f9c933b55756e738bc864.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690106846067"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690106846067"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690106846067"}]},"ts":"1690106846067"} 2023-07-23 10:07:26,069 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=73, state=RUNNABLE; CloseRegionProcedure f763da838d17186aea3ca317c998be82, server=jenkins-hbase4.apache.org,36827,1690106767853}] 2023-07-23 10:07:26,070 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=72, state=RUNNABLE; CloseRegionProcedure 57e8a642a49f9c933b55756e738bc864, server=jenkins-hbase4.apache.org,39563,1690106767800}] 2023-07-23 10:07:26,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-23 10:07:26,222 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f763da838d17186aea3ca317c998be82 2023-07-23 10:07:26,223 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f763da838d17186aea3ca317c998be82, disabling compactions & flushes 2023-07-23 10:07:26,224 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1690106845377.f763da838d17186aea3ca317c998be82. 2023-07-23 10:07:26,224 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1690106845377.f763da838d17186aea3ca317c998be82. 2023-07-23 10:07:26,224 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1690106845377.f763da838d17186aea3ca317c998be82. after waiting 0 ms 2023-07-23 10:07:26,224 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1690106845377.f763da838d17186aea3ca317c998be82. 2023-07-23 10:07:26,224 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing f763da838d17186aea3ca317c998be82 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-23 10:07:26,224 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 57e8a642a49f9c933b55756e738bc864 2023-07-23 10:07:26,225 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 57e8a642a49f9c933b55756e738bc864, disabling compactions & flushes 2023-07-23 10:07:26,225 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1690106845377.57e8a642a49f9c933b55756e738bc864. 2023-07-23 10:07:26,225 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690106845377.57e8a642a49f9c933b55756e738bc864. 2023-07-23 10:07:26,225 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690106845377.57e8a642a49f9c933b55756e738bc864. after waiting 0 ms 2023-07-23 10:07:26,225 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1690106845377.57e8a642a49f9c933b55756e738bc864. 2023-07-23 10:07:26,225 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 57e8a642a49f9c933b55756e738bc864 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-23 10:07:26,247 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/57e8a642a49f9c933b55756e738bc864/.tmp/cf/98139c7ab188450dbc59f39a6602d828 2023-07-23 10:07:26,249 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f763da838d17186aea3ca317c998be82/.tmp/cf/c41a49d614b543f1ab57b85c027ee28e 2023-07-23 10:07:26,254 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/57e8a642a49f9c933b55756e738bc864/.tmp/cf/98139c7ab188450dbc59f39a6602d828 as hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/57e8a642a49f9c933b55756e738bc864/cf/98139c7ab188450dbc59f39a6602d828 2023-07-23 10:07:26,256 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f763da838d17186aea3ca317c998be82/.tmp/cf/c41a49d614b543f1ab57b85c027ee28e as hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f763da838d17186aea3ca317c998be82/cf/c41a49d614b543f1ab57b85c027ee28e 2023-07-23 10:07:26,259 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/57e8a642a49f9c933b55756e738bc864/cf/98139c7ab188450dbc59f39a6602d828, entries=1, sequenceid=5, filesize=4.7 K 2023-07-23 10:07:26,260 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 57e8a642a49f9c933b55756e738bc864 in 35ms, sequenceid=5, compaction requested=false 2023-07-23 10:07:26,260 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-23 10:07:26,265 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f763da838d17186aea3ca317c998be82/cf/c41a49d614b543f1ab57b85c027ee28e, entries=1, sequenceid=5, filesize=4.7 K 2023-07-23 10:07:26,266 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for f763da838d17186aea3ca317c998be82 in 42ms, sequenceid=5, compaction requested=false 2023-07-23 10:07:26,271 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/57e8a642a49f9c933b55756e738bc864/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-23 10:07:26,272 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 10:07:26,272 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1690106845377.57e8a642a49f9c933b55756e738bc864. 2023-07-23 10:07:26,272 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 57e8a642a49f9c933b55756e738bc864: 2023-07-23 10:07:26,273 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f763da838d17186aea3ca317c998be82/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-23 10:07:26,273 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 10:07:26,274 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1690106845377.f763da838d17186aea3ca317c998be82. 2023-07-23 10:07:26,274 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f763da838d17186aea3ca317c998be82: 2023-07-23 10:07:26,279 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 57e8a642a49f9c933b55756e738bc864 2023-07-23 10:07:26,280 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=57e8a642a49f9c933b55756e738bc864, regionState=CLOSED 2023-07-23 10:07:26,280 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690106845377.57e8a642a49f9c933b55756e738bc864.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690106846279"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690106846279"}]},"ts":"1690106846279"} 2023-07-23 10:07:26,280 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f763da838d17186aea3ca317c998be82 2023-07-23 10:07:26,280 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=f763da838d17186aea3ca317c998be82, regionState=CLOSED 2023-07-23 10:07:26,280 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690106845377.f763da838d17186aea3ca317c998be82.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690106846280"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690106846280"}]},"ts":"1690106846280"} 2023-07-23 10:07:26,287 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=72 2023-07-23 10:07:26,287 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=72, state=SUCCESS; CloseRegionProcedure 57e8a642a49f9c933b55756e738bc864, server=jenkins-hbase4.apache.org,39563,1690106767800 in 213 msec 2023-07-23 10:07:26,288 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=73 2023-07-23 10:07:26,288 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=57e8a642a49f9c933b55756e738bc864, UNASSIGN in 233 msec 2023-07-23 10:07:26,288 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=73, state=SUCCESS; CloseRegionProcedure f763da838d17186aea3ca317c998be82, server=jenkins-hbase4.apache.org,36827,1690106767853 in 216 msec 2023-07-23 10:07:26,292 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=73, resume processing ppid=71 2023-07-23 10:07:26,292 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f763da838d17186aea3ca317c998be82, UNASSIGN in 230 msec 2023-07-23 10:07:26,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-23 10:07:26,379 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4d631bd1261dba1b8ed55a28c62251ec/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-23 10:07:26,381 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690106845377.57e8a642a49f9c933b55756e738bc864.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-23 10:07:26,381 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690106845377.f763da838d17186aea3ca317c998be82.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-23 10:07:26,381 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690106845378.4d631bd1261dba1b8ed55a28c62251ec.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-23 10:07:26,441 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4d631bd1261dba1b8ed55a28c62251ec, ASSIGN}] 2023-07-23 10:07:26,443 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4d631bd1261dba1b8ed55a28c62251ec, ASSIGN 2023-07-23 10:07:26,445 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4d631bd1261dba1b8ed55a28c62251ec, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,39563,1690106767800; forceNewPlan=false, retain=false 2023-07-23 10:07:26,595 INFO [jenkins-hbase4:34097] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-23 10:07:26,597 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=4d631bd1261dba1b8ed55a28c62251ec, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:07:26,598 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690106845378.4d631bd1261dba1b8ed55a28c62251ec.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1690106846597"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690106846597"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690106846597"}]},"ts":"1690106846597"} 2023-07-23 10:07:26,601 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 4d631bd1261dba1b8ed55a28c62251ec, server=jenkins-hbase4.apache.org,39563,1690106767800}] 2023-07-23 10:07:26,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-23 10:07:26,757 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1690106845378.4d631bd1261dba1b8ed55a28c62251ec. 2023-07-23 10:07:26,757 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4d631bd1261dba1b8ed55a28c62251ec, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690106845378.4d631bd1261dba1b8ed55a28c62251ec.', STARTKEY => '', ENDKEY => ''} 2023-07-23 10:07:26,757 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1690106845378.4d631bd1261dba1b8ed55a28c62251ec. service=AccessControlService 2023-07-23 10:07:26,758 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 10:07:26,758 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 4d631bd1261dba1b8ed55a28c62251ec 2023-07-23 10:07:26,758 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1690106845378.4d631bd1261dba1b8ed55a28c62251ec.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 10:07:26,758 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4d631bd1261dba1b8ed55a28c62251ec 2023-07-23 10:07:26,758 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4d631bd1261dba1b8ed55a28c62251ec 2023-07-23 10:07:26,759 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4d631bd1261dba1b8ed55a28c62251ec/.regioninfo 2023-07-23 10:07:26,773 INFO [StoreOpener-4d631bd1261dba1b8ed55a28c62251ec-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 4d631bd1261dba1b8ed55a28c62251ec 2023-07-23 10:07:26,774 DEBUG [StoreOpener-4d631bd1261dba1b8ed55a28c62251ec-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4d631bd1261dba1b8ed55a28c62251ec/cf 2023-07-23 10:07:26,774 DEBUG [StoreOpener-4d631bd1261dba1b8ed55a28c62251ec-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4d631bd1261dba1b8ed55a28c62251ec/cf 2023-07-23 10:07:26,774 INFO [StoreOpener-4d631bd1261dba1b8ed55a28c62251ec-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4d631bd1261dba1b8ed55a28c62251ec columnFamilyName cf 2023-07-23 10:07:26,804 DEBUG [StoreOpener-4d631bd1261dba1b8ed55a28c62251ec-1] regionserver.HStore(539): loaded hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4d631bd1261dba1b8ed55a28c62251ec/cf/98139c7ab188450dbc59f39a6602d828.57e8a642a49f9c933b55756e738bc864->hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/57e8a642a49f9c933b55756e738bc864/cf/98139c7ab188450dbc59f39a6602d828-top 2023-07-23 10:07:26,814 DEBUG [StoreOpener-4d631bd1261dba1b8ed55a28c62251ec-1] regionserver.HStore(539): loaded hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4d631bd1261dba1b8ed55a28c62251ec/cf/c41a49d614b543f1ab57b85c027ee28e.f763da838d17186aea3ca317c998be82->hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f763da838d17186aea3ca317c998be82/cf/c41a49d614b543f1ab57b85c027ee28e-top 2023-07-23 10:07:26,815 INFO [StoreOpener-4d631bd1261dba1b8ed55a28c62251ec-1] regionserver.HStore(310): Store=4d631bd1261dba1b8ed55a28c62251ec/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 10:07:26,816 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4d631bd1261dba1b8ed55a28c62251ec 2023-07-23 10:07:26,817 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4d631bd1261dba1b8ed55a28c62251ec 2023-07-23 10:07:26,823 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4d631bd1261dba1b8ed55a28c62251ec 2023-07-23 10:07:26,824 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4d631bd1261dba1b8ed55a28c62251ec; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64696046, jitterRate=-0.035953789949417114}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 10:07:26,824 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4d631bd1261dba1b8ed55a28c62251ec: 2023-07-23 10:07:26,825 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1690106845378.4d631bd1261dba1b8ed55a28c62251ec., pid=77, masterSystemTime=1690106846753 2023-07-23 10:07:26,826 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1690106845378.4d631bd1261dba1b8ed55a28c62251ec.,because compaction is disabled. 2023-07-23 10:07:26,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1690106845378.4d631bd1261dba1b8ed55a28c62251ec. 2023-07-23 10:07:26,827 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1690106845378.4d631bd1261dba1b8ed55a28c62251ec. 2023-07-23 10:07:26,828 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=4d631bd1261dba1b8ed55a28c62251ec, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:07:26,828 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690106845378.4d631bd1261dba1b8ed55a28c62251ec.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1690106846828"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690106846828"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690106846828"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690106846828"}]},"ts":"1690106846828"} 2023-07-23 10:07:26,831 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-23 10:07:26,831 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 4d631bd1261dba1b8ed55a28c62251ec, server=jenkins-hbase4.apache.org,39563,1690106767800 in 228 msec 2023-07-23 10:07:26,832 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-23 10:07:26,832 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4d631bd1261dba1b8ed55a28c62251ec, ASSIGN in 390 msec 2023-07-23 10:07:26,834 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[57e8a642a49f9c933b55756e738bc864, f763da838d17186aea3ca317c998be82], force=true in 812 msec 2023-07-23 10:07:27,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-23 10:07:27,138 INFO [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-23 10:07:27,139 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-23 10:07:27,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690106847139 (current time:1690106847139). 2023-07-23 10:07:27,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-23 10:07:27,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] zookeeper.ReadOnlyZKClient(139): Connect 0x60074020 to 127.0.0.1:55181 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 10:07:27,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@232f6459, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 10:07:27,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 10:07:27,164 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56752, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 10:07:27,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x60074020 to 127.0.0.1:55181 2023-07-23 10:07:27,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 10:07:27,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] zookeeper.ReadOnlyZKClient(139): Connect 0x28f15080 to 127.0.0.1:55181 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 10:07:27,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@72ad03fe, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 10:07:27,210 DEBUG [hconnection-0x2af8bc5e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 10:07:27,215 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56758, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 10:07:27,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x28f15080 to 127.0.0.1:55181 2023-07-23 10:07:27,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 10:07:27,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-23 10:07:27,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-23 10:07:27,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-23 10:07:27,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-23 10:07:27,234 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-23 10:07:27,235 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1690107447235 2023-07-23 10:07:27,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-23 10:07:27,236 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:27,236 DEBUG [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-23 10:07:27,236 DEBUG [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-23 10:07:27,249 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-23 10:07:27,251 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-23 10:07:27,254 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 20 msec 2023-07-23 10:07:27,256 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-23 10:07:27,257 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1690107447256 2023-07-23 10:07:27,333 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:27,333 INFO [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-23 10:07:27,333 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:07:27,334 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-23 10:07:27,334 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-23 10:07:27,335 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:27,335 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:27,337 DEBUG [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 10:07:27,337 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:07:27,337 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:07:27,337 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:07:27,337 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:07:27,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:07:27,337 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:07:27,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:07:27,337 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:07:27,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:07:27,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:27,337 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:07:27,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:27,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:27,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-23 10:07:27,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-23 10:07:27,338 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:27,338 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:27,339 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:27,339 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:07:27,339 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-23 10:07:27,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-23 10:07:27,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:27,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-23 10:07:27,339 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-23 10:07:27,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-23 10:07:27,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:27,339 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-23 10:07:27,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:27,340 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-23 10:07:27,340 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:27,340 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-23 10:07:27,340 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:07:27,342 DEBUG [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-23 10:07:27,343 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:27,347 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:27,344 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-23 10:07:27,347 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-23 10:07:27,347 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-23 10:07:27,347 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-23 10:07:27,347 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36827,1690106767853' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-23 10:07:27,347 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:07:27,347 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:07:27,349 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-23 10:07:27,351 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-23 10:07:27,350 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-23 10:07:27,351 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-23 10:07:27,351 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39563,1690106767800' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-23 10:07:27,351 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36599,1690106767729' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-23 10:07:27,353 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:27,354 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:27,354 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:27,354 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:07:27,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:07:27,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:07:27,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:07:27,354 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:27,354 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 10:07:27,354 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:27,354 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 10:07:27,354 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:27,354 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 10:07:27,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:07:27,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:07:27,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:27,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:07:27,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:07:27,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:07:27,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:07:27,357 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39563,1690106767800' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-23 10:07:27,357 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4dc9d531[Count = 0] remaining members to acquire global barrier 2023-07-23 10:07:27,357 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-23 10:07:27,357 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:27,359 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:27,359 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:27,359 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:27,359 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:27,359 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:27,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:27,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:27,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:27,360 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-23 10:07:27,360 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-23 10:07:27,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:27,360 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:07:27,360 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-23 10:07:27,360 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-23 10:07:27,360 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-23 10:07:27,360 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-23 10:07:27,360 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,36599,1690106767729' in zk 2023-07-23 10:07:27,360 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,36827,1690106767853' in zk 2023-07-23 10:07:27,362 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-23 10:07:27,362 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:07:27,362 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-23 10:07:27,362 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-23 10:07:27,362 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:07:27,362 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 10:07:27,367 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 10:07:27,362 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-23 10:07:27,368 DEBUG [rs(jenkins-hbase4.apache.org,39563,1690106767800)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1690106845378.4d631bd1261dba1b8ed55a28c62251ec. 2023-07-23 10:07:27,368 DEBUG [rs(jenkins-hbase4.apache.org,39563,1690106767800)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1690106845378.4d631bd1261dba1b8ed55a28c62251ec. started... 2023-07-23 10:07:27,369 DEBUG [rs(jenkins-hbase4.apache.org,39563,1690106767800)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4d631bd1261dba1b8ed55a28c62251ec: 2023-07-23 10:07:27,370 DEBUG [rs(jenkins-hbase4.apache.org,39563,1690106767800)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690106845378.4d631bd1261dba1b8ed55a28c62251ec.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:27,370 DEBUG [rs(jenkins-hbase4.apache.org,39563,1690106767800)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 10:07:27,370 DEBUG [rs(jenkins-hbase4.apache.org,39563,1690106767800)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4d631bd1261dba1b8ed55a28c62251ec/cf/98139c7ab188450dbc59f39a6602d828.57e8a642a49f9c933b55756e738bc864->hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/57e8a642a49f9c933b55756e738bc864/cf/98139c7ab188450dbc59f39a6602d828-top, hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4d631bd1261dba1b8ed55a28c62251ec/cf/c41a49d614b543f1ab57b85c027ee28e.f763da838d17186aea3ca317c998be82->hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f763da838d17186aea3ca317c998be82/cf/c41a49d614b543f1ab57b85c027ee28e-top] hfiles 2023-07-23 10:07:27,370 DEBUG [rs(jenkins-hbase4.apache.org,39563,1690106767800)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4d631bd1261dba1b8ed55a28c62251ec/cf/98139c7ab188450dbc59f39a6602d828.57e8a642a49f9c933b55756e738bc864 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:27,371 DEBUG [rs(jenkins-hbase4.apache.org,39563,1690106767800)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4d631bd1261dba1b8ed55a28c62251ec/cf/c41a49d614b543f1ab57b85c027ee28e.f763da838d17186aea3ca317c998be82 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:27,387 DEBUG [rs(jenkins-hbase4.apache.org,39563,1690106767800)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1690106845378.4d631bd1261dba1b8ed55a28c62251ec. completed. 2023-07-23 10:07:27,387 DEBUG [rs(jenkins-hbase4.apache.org,39563,1690106767800)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1690106845378.4d631bd1261dba1b8ed55a28c62251ec. 2023-07-23 10:07:27,387 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 10:07:27,387 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 10:07:27,387 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:07:27,387 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-23 10:07:27,387 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,39563,1690106767800' in zk 2023-07-23 10:07:27,393 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:07:27,393 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-23 10:07:27,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:07:27,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:07:27,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:07:27,393 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:07:27,393 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-23 10:07:27,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:07:27,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:07:27,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:27,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:07:27,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:07:27,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:07:27,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:07:27,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:27,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:07:27,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:07:27,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:07:27,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,39563,1690106767800': 2023-07-23 10:07:27,405 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39563,1690106767800' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-23 10:07:27,405 INFO [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-23 10:07:27,405 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-23 10:07:27,405 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-23 10:07:27,405 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:27,405 INFO [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-23 10:07:27,408 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:27,408 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:07:27,408 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:27,408 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:27,408 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:07:27,408 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:27,408 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:07:27,408 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:27,408 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:27,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:27,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:07:27,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:07:27,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:27,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:27,408 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:27,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:27,409 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:07:27,409 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:07:27,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:07:27,409 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:07:27,409 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:07:27,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:07:27,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:27,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:27,410 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:07:27,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:07:27,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:27,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:07:27,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:07:27,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:07:27,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:27,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:27,415 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:07:27,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:07:27,419 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:07:27,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:07:27,423 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:07:27,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:07:27,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:07:27,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:27,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:07:27,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:07:27,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:07:27,431 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:07:27,431 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:07:27,431 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:07:27,431 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:07:27,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:07:27,432 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:07:27,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:07:27,432 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:07:27,432 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:07:27,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:07:27,433 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:07:27,433 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:07:27,433 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:27,433 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:07:27,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:07:27,433 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:27,434 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:27,433 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:07:27,433 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 because node does not exist (not an error) 2023-07-23 10:07:27,433 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:07:27,433 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:07:27,433 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:07:27,434 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:07:27,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:07:27,434 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:27,434 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:07:27,434 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:27,434 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:07:27,435 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:07:27,435 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:27,435 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:27,435 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:07:27,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:07:27,436 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:27,520 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:27,543 DEBUG [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 10:07:27,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-23 10:07:27,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-23 10:07:27,544 DEBUG [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-23 10:07:27,577 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690106775176_0004_000001 (auth:SIMPLE) 2023-07-23 10:07:27,844 DEBUG [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 10:07:27,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-23 10:07:27,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-23 10:07:27,846 DEBUG [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-23 10:07:28,011 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-23 10:07:28,012 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:28,013 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:28,013 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1690106847236Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1690106847434 (+198 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1690106847434Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1690106847440 (+6 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1690106847494 (+54 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1690106848011 (+517 ms) 2023-07-23 10:07:28,016 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-23 10:07:28,021 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 768 msec 2023-07-23 10:07:28,346 DEBUG [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 10:07:28,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-23 10:07:28,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-23 10:07:28,348 INFO [Listener at jenkins-hbase4.apache.org/44565] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/export-test/export-1690106848348 2023-07-23 10:07:28,348 INFO [Listener at jenkins-hbase4.apache.org/44565] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:37479, tgtDir=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/export-test/export-1690106848348, rawTgtDir=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/export-test/export-1690106848348, srcFsUri=hdfs://localhost:37479, srcDir=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528 2023-07-23 10:07:28,381 DEBUG [Listener at jenkins-hbase4.apache.org/44565] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:37479, inputRoot=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528 2023-07-23 10:07:28,381 DEBUG [Listener at jenkins-hbase4.apache.org/44565] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1528319657_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/export-test/export-1690106848348, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/export-test/export-1690106848348/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:28,381 INFO [Listener at jenkins-hbase4.apache.org/44565] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:37479, inputRoot=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528, snapshotDir=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-23 10:07:28,392 INFO [Listener at jenkins-hbase4.apache.org/44565] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/export-test/export-1690106848348/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:28,447 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-23 10:07:28,448 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-23 10:07:28,448 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-23 10:07:28,449 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-23 10:07:28,449 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-23 10:07:28,449 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-23 10:07:28,450 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-23 10:07:28,535 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f0c2d64d-3350-bc69-1c38-d6964a44400f/hadoop-6266835374724772583.jar 2023-07-23 10:07:28,536 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-23 10:07:28,536 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-23 10:07:28,536 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-23 10:07:28,537 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-23 10:07:28,537 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-23 10:07:28,537 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-23 10:07:28,538 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-23 10:07:28,539 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-23 10:07:28,539 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-23 10:07:28,540 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-23 10:07:28,540 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-23 10:07:28,541 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-23 10:07:28,541 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-23 10:07:28,542 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-23 10:07:28,542 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-23 10:07:28,543 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-23 10:07:28,543 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 10:07:28,543 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 10:07:28,544 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 10:07:28,544 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 10:07:28,544 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 10:07:28,544 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 10:07:28,545 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 10:07:28,719 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-23 10:07:28,983 WARN [DataStreamer for file /user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/hadoop/mapreduce-am-staging-root-dir/jenkins/.staging/job_1690106775176_0005/libjars/protobuf-java-2.5.0.jar] hdfs.DataStreamer(982): Caught exception java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Thread.join(Thread.java:1257) at java.lang.Thread.join(Thread.java:1331) at org.apache.hadoop.hdfs.DataStreamer.closeResponder(DataStreamer.java:980) at org.apache.hadoop.hdfs.DataStreamer.endBlock(DataStreamer.java:630) at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:807) 2023-07-23 10:07:30,393 WARN [Listener at jenkins-hbase4.apache.org/44565] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-23 10:07:30,396 INFO [Listener at jenkins-hbase4.apache.org/44565] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-23 10:07:30,398 DEBUG [Listener at jenkins-hbase4.apache.org/44565] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-23 10:07:30,628 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 10:07:30,629 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 10:07:31,275 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690106775176_0005_000001 (auth:SIMPLE) 2023-07-23 10:07:37,335 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690106775176_0005_000001 (auth:SIMPLE) 2023-07-23 10:07:39,677 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690106775176_0005_000001 (auth:SIMPLE) 2023-07-23 10:07:44,723 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690106775176_0005_000001 (auth:SIMPLE) 2023-07-23 10:07:45,822 INFO [Listener at jenkins-hbase4.apache.org/44565] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-23 10:07:45,825 INFO [Listener at jenkins-hbase4.apache.org/44565] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-23 10:07:45,837 INFO [Listener at jenkins-hbase4.apache.org/44565] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:45,837 INFO [Listener at jenkins-hbase4.apache.org/44565] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-23 10:07:45,838 INFO [Listener at jenkins-hbase4.apache.org/44565] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-23 10:07:45,838 DEBUG [Listener at jenkins-hbase4.apache.org/44565] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-165846724_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:45,838 DEBUG [Listener at jenkins-hbase4.apache.org/44565] snapshot.TestExportSnapshot(367): hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-23 10:07:45,838 DEBUG [Listener at jenkins-hbase4.apache.org/44565] snapshot.TestExportSnapshot(367): hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-23 10:07:45,838 DEBUG [Listener at jenkins-hbase4.apache.org/44565] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-165846724_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/export-test/export-1690106848348/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/export-test/export-1690106848348/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:45,839 DEBUG [Listener at jenkins-hbase4.apache.org/44565] snapshot.TestExportSnapshot(367): hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/export-test/export-1690106848348/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-23 10:07:45,839 DEBUG [Listener at jenkins-hbase4.apache.org/44565] snapshot.TestExportSnapshot(367): hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/export-test/export-1690106848348/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-23 10:07:45,848 INFO [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:45,849 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:45,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:45,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-23 10:07:45,854 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690106865854"}]},"ts":"1690106865854"} 2023-07-23 10:07:45,855 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-23 10:07:45,858 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-23 10:07:45,858 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4d631bd1261dba1b8ed55a28c62251ec, UNASSIGN}] 2023-07-23 10:07:45,860 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4d631bd1261dba1b8ed55a28c62251ec, UNASSIGN 2023-07-23 10:07:45,861 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=4d631bd1261dba1b8ed55a28c62251ec, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:07:45,861 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690106845378.4d631bd1261dba1b8ed55a28c62251ec.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1690106865861"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690106865861"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690106865861"}]},"ts":"1690106865861"} 2023-07-23 10:07:45,863 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 4d631bd1261dba1b8ed55a28c62251ec, server=jenkins-hbase4.apache.org,39563,1690106767800}] 2023-07-23 10:07:45,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-23 10:07:46,014 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 4d631bd1261dba1b8ed55a28c62251ec 2023-07-23 10:07:46,015 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4d631bd1261dba1b8ed55a28c62251ec, disabling compactions & flushes 2023-07-23 10:07:46,015 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1690106845378.4d631bd1261dba1b8ed55a28c62251ec. 2023-07-23 10:07:46,015 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690106845378.4d631bd1261dba1b8ed55a28c62251ec. 2023-07-23 10:07:46,015 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690106845378.4d631bd1261dba1b8ed55a28c62251ec. after waiting 0 ms 2023-07-23 10:07:46,015 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1690106845378.4d631bd1261dba1b8ed55a28c62251ec. 2023-07-23 10:07:46,025 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4d631bd1261dba1b8ed55a28c62251ec/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-23 10:07:46,026 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 10:07:46,027 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1690106845378.4d631bd1261dba1b8ed55a28c62251ec. 2023-07-23 10:07:46,027 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4d631bd1261dba1b8ed55a28c62251ec: 2023-07-23 10:07:46,028 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 4d631bd1261dba1b8ed55a28c62251ec 2023-07-23 10:07:46,029 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=4d631bd1261dba1b8ed55a28c62251ec, regionState=CLOSED 2023-07-23 10:07:46,029 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690106845378.4d631bd1261dba1b8ed55a28c62251ec.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1690106866029"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690106866029"}]},"ts":"1690106866029"} 2023-07-23 10:07:46,032 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-23 10:07:46,032 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 4d631bd1261dba1b8ed55a28c62251ec, server=jenkins-hbase4.apache.org,39563,1690106767800 in 167 msec 2023-07-23 10:07:46,033 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-23 10:07:46,033 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4d631bd1261dba1b8ed55a28c62251ec, UNASSIGN in 174 msec 2023-07-23 10:07:46,034 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690106866034"}]},"ts":"1690106866034"} 2023-07-23 10:07:46,035 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-23 10:07:46,037 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-23 10:07:46,039 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 189 msec 2023-07-23 10:07:46,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-23 10:07:46,157 INFO [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-23 10:07:46,157 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:46,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:46,161 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:46,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:46,162 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:46,164 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39563] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:46,166 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:46,166 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:46,166 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4d631bd1261dba1b8ed55a28c62251ec 2023-07-23 10:07:46,166 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/57e8a642a49f9c933b55756e738bc864 2023-07-23 10:07:46,166 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:46,166 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f763da838d17186aea3ca317c998be82 2023-07-23 10:07:46,167 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-23 10:07:46,167 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-23 10:07:46,167 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-23 10:07:46,168 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:46,169 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4d631bd1261dba1b8ed55a28c62251ec/cf, FileablePath, hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4d631bd1261dba1b8ed55a28c62251ec/recovered.edits] 2023-07-23 10:07:46,169 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:46,169 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-07-23 10:07:46,169 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:07:46,169 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:46,169 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:46,170 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:07:46,169 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:07:46,170 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:07:46,169 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-23 10:07:46,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-23 10:07:46,171 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-23 10:07:46,171 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-23 10:07:46,171 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-23 10:07:46,171 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-23 10:07:46,185 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/57e8a642a49f9c933b55756e738bc864/cf, FileablePath, hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/57e8a642a49f9c933b55756e738bc864/recovered.edits] 2023-07-23 10:07:46,185 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f763da838d17186aea3ca317c998be82/cf, FileablePath, hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f763da838d17186aea3ca317c998be82/recovered.edits] 2023-07-23 10:07:46,191 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4d631bd1261dba1b8ed55a28c62251ec/cf/98139c7ab188450dbc59f39a6602d828.57e8a642a49f9c933b55756e738bc864 to hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4d631bd1261dba1b8ed55a28c62251ec/cf/98139c7ab188450dbc59f39a6602d828.57e8a642a49f9c933b55756e738bc864 2023-07-23 10:07:46,192 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f763da838d17186aea3ca317c998be82/cf/c41a49d614b543f1ab57b85c027ee28e to hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f763da838d17186aea3ca317c998be82/cf/c41a49d614b543f1ab57b85c027ee28e 2023-07-23 10:07:46,192 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/57e8a642a49f9c933b55756e738bc864/cf/98139c7ab188450dbc59f39a6602d828 to hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/57e8a642a49f9c933b55756e738bc864/cf/98139c7ab188450dbc59f39a6602d828 2023-07-23 10:07:46,193 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4d631bd1261dba1b8ed55a28c62251ec/cf/c41a49d614b543f1ab57b85c027ee28e.f763da838d17186aea3ca317c998be82 to hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4d631bd1261dba1b8ed55a28c62251ec/cf/c41a49d614b543f1ab57b85c027ee28e.f763da838d17186aea3ca317c998be82 2023-07-23 10:07:46,196 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f763da838d17186aea3ca317c998be82/recovered.edits/8.seqid to hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f763da838d17186aea3ca317c998be82/recovered.edits/8.seqid 2023-07-23 10:07:46,196 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/57e8a642a49f9c933b55756e738bc864/recovered.edits/8.seqid to hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/57e8a642a49f9c933b55756e738bc864/recovered.edits/8.seqid 2023-07-23 10:07:46,197 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f763da838d17186aea3ca317c998be82 2023-07-23 10:07:46,197 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/57e8a642a49f9c933b55756e738bc864 2023-07-23 10:07:46,197 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4d631bd1261dba1b8ed55a28c62251ec/recovered.edits/12.seqid to hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4d631bd1261dba1b8ed55a28c62251ec/recovered.edits/12.seqid 2023-07-23 10:07:46,198 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4d631bd1261dba1b8ed55a28c62251ec 2023-07-23 10:07:46,198 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-23 10:07:46,200 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:46,203 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-23 10:07:46,209 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-23 10:07:46,210 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:46,210 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-23 10:07:46,211 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690106845378.4d631bd1261dba1b8ed55a28c62251ec.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690106866210"}]},"ts":"9223372036854775807"} 2023-07-23 10:07:46,216 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-23 10:07:46,216 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 4d631bd1261dba1b8ed55a28c62251ec, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690106845378.4d631bd1261dba1b8ed55a28c62251ec.', STARTKEY => '', ENDKEY => ''}] 2023-07-23 10:07:46,216 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-23 10:07:46,216 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690106866216"}]},"ts":"9223372036854775807"} 2023-07-23 10:07:46,218 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-23 10:07:46,222 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:46,224 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 65 msec 2023-07-23 10:07:46,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-23 10:07:46,272 INFO [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-23 10:07:46,273 INFO [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:46,273 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:46,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:46,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-23 10:07:46,279 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690106866279"}]},"ts":"1690106866279"} 2023-07-23 10:07:46,281 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-23 10:07:46,283 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-23 10:07:46,283 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=252a1ea38016c2dfc1f1109b2d0063b5, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0b562e5c83406565c5384eccba86910a, UNASSIGN}] 2023-07-23 10:07:46,286 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=252a1ea38016c2dfc1f1109b2d0063b5, UNASSIGN 2023-07-23 10:07:46,286 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0b562e5c83406565c5384eccba86910a, UNASSIGN 2023-07-23 10:07:46,293 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=0b562e5c83406565c5384eccba86910a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:07:46,293 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=252a1ea38016c2dfc1f1109b2d0063b5, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:07:46,293 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690106843408.252a1ea38016c2dfc1f1109b2d0063b5.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690106866293"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690106866293"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690106866293"}]},"ts":"1690106866293"} 2023-07-23 10:07:46,293 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690106843408.0b562e5c83406565c5384eccba86910a.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690106866293"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690106866293"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690106866293"}]},"ts":"1690106866293"} 2023-07-23 10:07:46,296 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=86, state=RUNNABLE; CloseRegionProcedure 0b562e5c83406565c5384eccba86910a, server=jenkins-hbase4.apache.org,36827,1690106767853}] 2023-07-23 10:07:46,297 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=85, state=RUNNABLE; CloseRegionProcedure 252a1ea38016c2dfc1f1109b2d0063b5, server=jenkins-hbase4.apache.org,36599,1690106767729}] 2023-07-23 10:07:46,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-23 10:07:46,448 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 0b562e5c83406565c5384eccba86910a 2023-07-23 10:07:46,448 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 252a1ea38016c2dfc1f1109b2d0063b5 2023-07-23 10:07:46,449 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0b562e5c83406565c5384eccba86910a, disabling compactions & flushes 2023-07-23 10:07:46,449 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1690106843408.0b562e5c83406565c5384eccba86910a. 2023-07-23 10:07:46,449 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 252a1ea38016c2dfc1f1109b2d0063b5, disabling compactions & flushes 2023-07-23 10:07:46,449 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1690106843408.0b562e5c83406565c5384eccba86910a. 2023-07-23 10:07:46,449 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1690106843408.252a1ea38016c2dfc1f1109b2d0063b5. 2023-07-23 10:07:46,449 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1690106843408.0b562e5c83406565c5384eccba86910a. after waiting 0 ms 2023-07-23 10:07:46,449 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1690106843408.252a1ea38016c2dfc1f1109b2d0063b5. 2023-07-23 10:07:46,449 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1690106843408.0b562e5c83406565c5384eccba86910a. 2023-07-23 10:07:46,449 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1690106843408.252a1ea38016c2dfc1f1109b2d0063b5. after waiting 0 ms 2023-07-23 10:07:46,449 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1690106843408.252a1ea38016c2dfc1f1109b2d0063b5. 2023-07-23 10:07:46,470 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemStateWithMergeRegion/252a1ea38016c2dfc1f1109b2d0063b5/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-23 10:07:46,471 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemStateWithMergeRegion/0b562e5c83406565c5384eccba86910a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-23 10:07:46,471 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 10:07:46,472 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1690106843408.252a1ea38016c2dfc1f1109b2d0063b5. 2023-07-23 10:07:46,472 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 252a1ea38016c2dfc1f1109b2d0063b5: 2023-07-23 10:07:46,473 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 10:07:46,474 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1690106843408.0b562e5c83406565c5384eccba86910a. 2023-07-23 10:07:46,474 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0b562e5c83406565c5384eccba86910a: 2023-07-23 10:07:46,475 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 252a1ea38016c2dfc1f1109b2d0063b5 2023-07-23 10:07:46,475 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=252a1ea38016c2dfc1f1109b2d0063b5, regionState=CLOSED 2023-07-23 10:07:46,475 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690106843408.252a1ea38016c2dfc1f1109b2d0063b5.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690106866475"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690106866475"}]},"ts":"1690106866475"} 2023-07-23 10:07:46,479 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 0b562e5c83406565c5384eccba86910a 2023-07-23 10:07:46,480 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=0b562e5c83406565c5384eccba86910a, regionState=CLOSED 2023-07-23 10:07:46,480 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690106843408.0b562e5c83406565c5384eccba86910a.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690106866480"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690106866480"}]},"ts":"1690106866480"} 2023-07-23 10:07:46,480 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=85 2023-07-23 10:07:46,480 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=85, state=SUCCESS; CloseRegionProcedure 252a1ea38016c2dfc1f1109b2d0063b5, server=jenkins-hbase4.apache.org,36599,1690106767729 in 180 msec 2023-07-23 10:07:46,482 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=252a1ea38016c2dfc1f1109b2d0063b5, UNASSIGN in 197 msec 2023-07-23 10:07:46,483 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=86 2023-07-23 10:07:46,483 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=86, state=SUCCESS; CloseRegionProcedure 0b562e5c83406565c5384eccba86910a, server=jenkins-hbase4.apache.org,36827,1690106767853 in 185 msec 2023-07-23 10:07:46,485 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=86, resume processing ppid=84 2023-07-23 10:07:46,485 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0b562e5c83406565c5384eccba86910a, UNASSIGN in 200 msec 2023-07-23 10:07:46,485 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690106866485"}]},"ts":"1690106866485"} 2023-07-23 10:07:46,486 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-23 10:07:46,488 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-23 10:07:46,490 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 216 msec 2023-07-23 10:07:46,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-23 10:07:46,582 INFO [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-23 10:07:46,583 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:46,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:46,588 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:46,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:46,589 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:46,591 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39563] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:46,594 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:46,594 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:46,594 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:46,594 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:46,595 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-23 10:07:46,595 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-23 10:07:46,595 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-23 10:07:46,595 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-23 10:07:46,597 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/252a1ea38016c2dfc1f1109b2d0063b5 2023-07-23 10:07:46,598 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0b562e5c83406565c5384eccba86910a 2023-07-23 10:07:46,599 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:46,599 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:07:46,599 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:46,599 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:07:46,599 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:46,599 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:07:46,599 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:46,599 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:07:46,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-23 10:07:46,602 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/252a1ea38016c2dfc1f1109b2d0063b5/cf, FileablePath, hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/252a1ea38016c2dfc1f1109b2d0063b5/recovered.edits] 2023-07-23 10:07:46,605 DEBUG [HFileArchiver-16] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0b562e5c83406565c5384eccba86910a/cf, FileablePath, hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0b562e5c83406565c5384eccba86910a/recovered.edits] 2023-07-23 10:07:46,615 DEBUG [HFileArchiver-16] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0b562e5c83406565c5384eccba86910a/cf/acaf9ec2a915487da467809a28cbb94f to hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/0b562e5c83406565c5384eccba86910a/cf/acaf9ec2a915487da467809a28cbb94f 2023-07-23 10:07:46,616 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/252a1ea38016c2dfc1f1109b2d0063b5/cf/6b949ca8746140dc942adc3e567416f7 to hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/252a1ea38016c2dfc1f1109b2d0063b5/cf/6b949ca8746140dc942adc3e567416f7 2023-07-23 10:07:46,620 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/252a1ea38016c2dfc1f1109b2d0063b5/recovered.edits/9.seqid to hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/252a1ea38016c2dfc1f1109b2d0063b5/recovered.edits/9.seqid 2023-07-23 10:07:46,620 DEBUG [HFileArchiver-16] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0b562e5c83406565c5384eccba86910a/recovered.edits/9.seqid to hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/0b562e5c83406565c5384eccba86910a/recovered.edits/9.seqid 2023-07-23 10:07:46,621 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/252a1ea38016c2dfc1f1109b2d0063b5 2023-07-23 10:07:46,622 DEBUG [HFileArchiver-16] backup.HFileArchiver(596): Deleted hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0b562e5c83406565c5384eccba86910a 2023-07-23 10:07:46,622 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-23 10:07:46,623 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-23 10:07:46,624 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-07-23 10:07:46,629 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202307235f6d2a5692974e838fede939889ef523 to hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202307235f6d2a5692974e838fede939889ef523 2023-07-23 10:07:46,632 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e2023072364d242d9cc6443d98cf73421f327d99d to hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e2023072364d242d9cc6443d98cf73421f327d99d 2023-07-23 10:07:46,633 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-23 10:07:46,636 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:46,640 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-23 10:07:46,645 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-23 10:07:46,647 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:46,647 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-23 10:07:46,647 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690106843408.252a1ea38016c2dfc1f1109b2d0063b5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690106866647"}]},"ts":"9223372036854775807"} 2023-07-23 10:07:46,647 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690106843408.0b562e5c83406565c5384eccba86910a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690106866647"}]},"ts":"9223372036854775807"} 2023-07-23 10:07:46,649 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-23 10:07:46,649 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 252a1ea38016c2dfc1f1109b2d0063b5, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1690106843408.252a1ea38016c2dfc1f1109b2d0063b5.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 0b562e5c83406565c5384eccba86910a, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1690106843408.0b562e5c83406565c5384eccba86910a.', STARTKEY => '1', ENDKEY => ''}] 2023-07-23 10:07:46,649 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-23 10:07:46,649 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690106866649"}]},"ts":"9223372036854775807"} 2023-07-23 10:07:46,651 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-23 10:07:46,655 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:46,658 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 72 msec 2023-07-23 10:07:46,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-23 10:07:46,702 INFO [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-23 10:07:46,711 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-23 10:07:46,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:46,714 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-23 10:07:46,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 10:07:46,717 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-23 10:07:46,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 10:07:46,744 INFO [Listener at jenkins-hbase4.apache.org/44565] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=760 (was 748) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-242983147_1 at /127.0.0.1:44294 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3cfc6090-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1575588394) connection to jenkins-hbase4.apache.org/172.31.14.131:38397 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3cfc6090-shared-pool-28 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4222 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3cfc6090-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-242983147_1 at /127.0.0.1:59278 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-165846724_17 at /127.0.0.1:44330 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3cfc6090-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1575588394) connection to jenkins-hbase4.apache.org/172.31.14.131:32809 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3cfc6090-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3cfc6090-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-165846724_17 at /127.0.0.1:56376 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-165846724_17 at /127.0.0.1:59304 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=906 (was 907), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=492 (was 337) - SystemLoadAverage LEAK? -, ProcessCount=180 (was 176) - ProcessCount LEAK? -, AvailableMemoryMB=5682 (was 6957) 2023-07-23 10:07:46,744 WARN [Listener at jenkins-hbase4.apache.org/44565] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-07-23 10:07:46,765 INFO [Listener at jenkins-hbase4.apache.org/44565] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=760, OpenFileDescriptor=906, MaxFileDescriptor=60000, SystemLoadAverage=492, ProcessCount=180, AvailableMemoryMB=5681 2023-07-23 10:07:46,765 WARN [Listener at jenkins-hbase4.apache.org/44565] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-07-23 10:07:46,766 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-23 10:07:46,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-23 10:07:46,769 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-23 10:07:46,770 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-23 10:07:46,770 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-23 10:07:46,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-23 10:07:46,773 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testEmptyExportFileSystemState/b025f903a9345cfef1f272bdb7becc56 2023-07-23 10:07:46,773 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testEmptyExportFileSystemState/7712d5fabb599457616052b8c259bdb8 2023-07-23 10:07:46,773 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testEmptyExportFileSystemState/b025f903a9345cfef1f272bdb7becc56 empty. 2023-07-23 10:07:46,773 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testEmptyExportFileSystemState/7712d5fabb599457616052b8c259bdb8 empty. 2023-07-23 10:07:46,774 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testEmptyExportFileSystemState/b025f903a9345cfef1f272bdb7becc56 2023-07-23 10:07:46,774 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testEmptyExportFileSystemState/7712d5fabb599457616052b8c259bdb8 2023-07-23 10:07:46,774 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-23 10:07:46,784 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-23 10:07:46,785 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => b025f903a9345cfef1f272bdb7becc56, NAME => 'testtb-testEmptyExportFileSystemState,,1690106866766.b025f903a9345cfef1f272bdb7becc56.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp 2023-07-23 10:07:46,785 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 7712d5fabb599457616052b8c259bdb8, NAME => 'testtb-testEmptyExportFileSystemState,1,1690106866766.7712d5fabb599457616052b8c259bdb8.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp 2023-07-23 10:07:46,803 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1690106866766.7712d5fabb599457616052b8c259bdb8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 10:07:46,803 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 7712d5fabb599457616052b8c259bdb8, disabling compactions & flushes 2023-07-23 10:07:46,803 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1690106866766.7712d5fabb599457616052b8c259bdb8. 2023-07-23 10:07:46,803 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1690106866766.7712d5fabb599457616052b8c259bdb8. 2023-07-23 10:07:46,803 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1690106866766.7712d5fabb599457616052b8c259bdb8. after waiting 0 ms 2023-07-23 10:07:46,803 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1690106866766.7712d5fabb599457616052b8c259bdb8. 2023-07-23 10:07:46,803 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1690106866766.7712d5fabb599457616052b8c259bdb8. 2023-07-23 10:07:46,803 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 7712d5fabb599457616052b8c259bdb8: 2023-07-23 10:07:46,805 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1690106866766.b025f903a9345cfef1f272bdb7becc56.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 10:07:46,805 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing b025f903a9345cfef1f272bdb7becc56, disabling compactions & flushes 2023-07-23 10:07:46,805 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1690106866766.b025f903a9345cfef1f272bdb7becc56. 2023-07-23 10:07:46,805 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1690106866766.b025f903a9345cfef1f272bdb7becc56. 2023-07-23 10:07:46,805 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1690106866766.b025f903a9345cfef1f272bdb7becc56. after waiting 0 ms 2023-07-23 10:07:46,805 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1690106866766.b025f903a9345cfef1f272bdb7becc56. 2023-07-23 10:07:46,805 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1690106866766.b025f903a9345cfef1f272bdb7becc56. 2023-07-23 10:07:46,805 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for b025f903a9345cfef1f272bdb7becc56: 2023-07-23 10:07:46,807 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-23 10:07:46,808 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1690106866766.7712d5fabb599457616052b8c259bdb8.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690106866808"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690106866808"}]},"ts":"1690106866808"} 2023-07-23 10:07:46,808 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1690106866766.b025f903a9345cfef1f272bdb7becc56.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690106866808"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690106866808"}]},"ts":"1690106866808"} 2023-07-23 10:07:46,810 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-23 10:07:46,811 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-23 10:07:46,811 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690106866811"}]},"ts":"1690106866811"} 2023-07-23 10:07:46,812 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-23 10:07:46,817 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-23 10:07:46,818 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-23 10:07:46,818 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-23 10:07:46,818 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-23 10:07:46,818 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-23 10:07:46,819 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=b025f903a9345cfef1f272bdb7becc56, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=7712d5fabb599457616052b8c259bdb8, ASSIGN}] 2023-07-23 10:07:46,821 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=7712d5fabb599457616052b8c259bdb8, ASSIGN 2023-07-23 10:07:46,821 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=b025f903a9345cfef1f272bdb7becc56, ASSIGN 2023-07-23 10:07:46,822 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=7712d5fabb599457616052b8c259bdb8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39563,1690106767800; forceNewPlan=false, retain=false 2023-07-23 10:07:46,824 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=b025f903a9345cfef1f272bdb7becc56, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36599,1690106767729; forceNewPlan=false, retain=false 2023-07-23 10:07:46,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-23 10:07:46,972 INFO [jenkins-hbase4:34097] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-23 10:07:46,976 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=b025f903a9345cfef1f272bdb7becc56, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:07:46,976 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1690106866766.b025f903a9345cfef1f272bdb7becc56.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690106866976"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690106866976"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690106866976"}]},"ts":"1690106866976"} 2023-07-23 10:07:46,976 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=7712d5fabb599457616052b8c259bdb8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:07:46,977 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1690106866766.7712d5fabb599457616052b8c259bdb8.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690106866976"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690106866976"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690106866976"}]},"ts":"1690106866976"} 2023-07-23 10:07:46,982 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; OpenRegionProcedure b025f903a9345cfef1f272bdb7becc56, server=jenkins-hbase4.apache.org,36599,1690106767729}] 2023-07-23 10:07:46,984 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=92, state=RUNNABLE; OpenRegionProcedure 7712d5fabb599457616052b8c259bdb8, server=jenkins-hbase4.apache.org,39563,1690106767800}] 2023-07-23 10:07:47,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-23 10:07:47,139 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1690106866766.7712d5fabb599457616052b8c259bdb8. 2023-07-23 10:07:47,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7712d5fabb599457616052b8c259bdb8, NAME => 'testtb-testEmptyExportFileSystemState,1,1690106866766.7712d5fabb599457616052b8c259bdb8.', STARTKEY => '1', ENDKEY => ''} 2023-07-23 10:07:47,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1690106866766.7712d5fabb599457616052b8c259bdb8. service=AccessControlService 2023-07-23 10:07:47,140 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1690106866766.b025f903a9345cfef1f272bdb7becc56. 2023-07-23 10:07:47,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b025f903a9345cfef1f272bdb7becc56, NAME => 'testtb-testEmptyExportFileSystemState,,1690106866766.b025f903a9345cfef1f272bdb7becc56.', STARTKEY => '', ENDKEY => '1'} 2023-07-23 10:07:47,140 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 10:07:47,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1690106866766.b025f903a9345cfef1f272bdb7becc56. service=AccessControlService 2023-07-23 10:07:47,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 7712d5fabb599457616052b8c259bdb8 2023-07-23 10:07:47,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1690106866766.7712d5fabb599457616052b8c259bdb8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 10:07:47,141 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 10:07:47,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7712d5fabb599457616052b8c259bdb8 2023-07-23 10:07:47,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7712d5fabb599457616052b8c259bdb8 2023-07-23 10:07:47,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState b025f903a9345cfef1f272bdb7becc56 2023-07-23 10:07:47,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1690106866766.b025f903a9345cfef1f272bdb7becc56.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 10:07:47,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b025f903a9345cfef1f272bdb7becc56 2023-07-23 10:07:47,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b025f903a9345cfef1f272bdb7becc56 2023-07-23 10:07:47,142 INFO [StoreOpener-7712d5fabb599457616052b8c259bdb8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 7712d5fabb599457616052b8c259bdb8 2023-07-23 10:07:47,142 INFO [StoreOpener-b025f903a9345cfef1f272bdb7becc56-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b025f903a9345cfef1f272bdb7becc56 2023-07-23 10:07:47,144 DEBUG [StoreOpener-7712d5fabb599457616052b8c259bdb8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testEmptyExportFileSystemState/7712d5fabb599457616052b8c259bdb8/cf 2023-07-23 10:07:47,144 DEBUG [StoreOpener-b025f903a9345cfef1f272bdb7becc56-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testEmptyExportFileSystemState/b025f903a9345cfef1f272bdb7becc56/cf 2023-07-23 10:07:47,144 DEBUG [StoreOpener-b025f903a9345cfef1f272bdb7becc56-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testEmptyExportFileSystemState/b025f903a9345cfef1f272bdb7becc56/cf 2023-07-23 10:07:47,144 DEBUG [StoreOpener-7712d5fabb599457616052b8c259bdb8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testEmptyExportFileSystemState/7712d5fabb599457616052b8c259bdb8/cf 2023-07-23 10:07:47,144 INFO [StoreOpener-b025f903a9345cfef1f272bdb7becc56-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b025f903a9345cfef1f272bdb7becc56 columnFamilyName cf 2023-07-23 10:07:47,145 INFO [StoreOpener-7712d5fabb599457616052b8c259bdb8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7712d5fabb599457616052b8c259bdb8 columnFamilyName cf 2023-07-23 10:07:47,146 INFO [StoreOpener-7712d5fabb599457616052b8c259bdb8-1] regionserver.HStore(310): Store=7712d5fabb599457616052b8c259bdb8/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 10:07:47,146 INFO [StoreOpener-b025f903a9345cfef1f272bdb7becc56-1] regionserver.HStore(310): Store=b025f903a9345cfef1f272bdb7becc56/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 10:07:47,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testEmptyExportFileSystemState/b025f903a9345cfef1f272bdb7becc56 2023-07-23 10:07:47,148 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testEmptyExportFileSystemState/b025f903a9345cfef1f272bdb7becc56 2023-07-23 10:07:47,151 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b025f903a9345cfef1f272bdb7becc56 2023-07-23 10:07:47,153 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testEmptyExportFileSystemState/b025f903a9345cfef1f272bdb7becc56/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 10:07:47,154 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b025f903a9345cfef1f272bdb7becc56; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73559036, jitterRate=0.09611505270004272}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 10:07:47,154 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b025f903a9345cfef1f272bdb7becc56: 2023-07-23 10:07:47,155 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1690106866766.b025f903a9345cfef1f272bdb7becc56., pid=93, masterSystemTime=1690106867136 2023-07-23 10:07:47,155 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testEmptyExportFileSystemState/7712d5fabb599457616052b8c259bdb8 2023-07-23 10:07:47,156 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testEmptyExportFileSystemState/7712d5fabb599457616052b8c259bdb8 2023-07-23 10:07:47,159 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1690106866766.b025f903a9345cfef1f272bdb7becc56. 2023-07-23 10:07:47,159 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1690106866766.b025f903a9345cfef1f272bdb7becc56. 2023-07-23 10:07:47,159 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=b025f903a9345cfef1f272bdb7becc56, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:07:47,159 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1690106866766.b025f903a9345cfef1f272bdb7becc56.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690106867159"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690106867159"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690106867159"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690106867159"}]},"ts":"1690106867159"} 2023-07-23 10:07:47,161 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7712d5fabb599457616052b8c259bdb8 2023-07-23 10:07:47,163 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=91 2023-07-23 10:07:47,163 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=91, state=SUCCESS; OpenRegionProcedure b025f903a9345cfef1f272bdb7becc56, server=jenkins-hbase4.apache.org,36599,1690106767729 in 179 msec 2023-07-23 10:07:47,165 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=b025f903a9345cfef1f272bdb7becc56, ASSIGN in 345 msec 2023-07-23 10:07:47,167 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testEmptyExportFileSystemState/7712d5fabb599457616052b8c259bdb8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 10:07:47,167 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7712d5fabb599457616052b8c259bdb8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74556293, jitterRate=0.11097534000873566}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 10:07:47,167 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7712d5fabb599457616052b8c259bdb8: 2023-07-23 10:07:47,175 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1690106866766.7712d5fabb599457616052b8c259bdb8., pid=94, masterSystemTime=1690106867136 2023-07-23 10:07:47,177 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1690106866766.7712d5fabb599457616052b8c259bdb8. 2023-07-23 10:07:47,178 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1690106866766.7712d5fabb599457616052b8c259bdb8. 2023-07-23 10:07:47,178 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=7712d5fabb599457616052b8c259bdb8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:07:47,178 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1690106866766.7712d5fabb599457616052b8c259bdb8.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690106867178"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690106867178"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690106867178"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690106867178"}]},"ts":"1690106867178"} 2023-07-23 10:07:47,183 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=92 2023-07-23 10:07:47,183 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=92, state=SUCCESS; OpenRegionProcedure 7712d5fabb599457616052b8c259bdb8, server=jenkins-hbase4.apache.org,39563,1690106767800 in 196 msec 2023-07-23 10:07:47,195 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=92, resume processing ppid=90 2023-07-23 10:07:47,195 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=7712d5fabb599457616052b8c259bdb8, ASSIGN in 365 msec 2023-07-23 10:07:47,196 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-23 10:07:47,196 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690106867196"}]},"ts":"1690106867196"} 2023-07-23 10:07:47,197 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-23 10:07:47,201 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-23 10:07:47,201 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-23 10:07:47,203 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39563] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-23 10:07:47,205 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:07:47,205 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:07:47,205 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:07:47,205 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:07:47,208 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-23 10:07:47,208 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-23 10:07:47,208 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-23 10:07:47,208 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-23 10:07:47,209 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 442 msec 2023-07-23 10:07:47,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-23 10:07:47,375 INFO [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-23 10:07:47,380 DEBUG [Listener at jenkins-hbase4.apache.org/44565] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-23 10:07:47,381 DEBUG [Listener at jenkins-hbase4.apache.org/44565] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1690106866766.b025f903a9345cfef1f272bdb7becc56. 2023-07-23 10:07:47,382 INFO [Listener at jenkins-hbase4.apache.org/44565] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 10:07:47,394 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-23 10:07:47,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690106867394 (current time:1690106867394). 2023-07-23 10:07:47,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-23 10:07:47,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] zookeeper.ReadOnlyZKClient(139): Connect 0x6644e360 to 127.0.0.1:55181 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 10:07:47,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4874e45b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 10:07:47,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 10:07:47,419 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47240, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 10:07:47,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6644e360 to 127.0.0.1:55181 2023-07-23 10:07:47,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 10:07:47,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] zookeeper.ReadOnlyZKClient(139): Connect 0x1d0ad0dc to 127.0.0.1:55181 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 10:07:47,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5c947ffe, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 10:07:47,439 DEBUG [hconnection-0x332d1e0b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 10:07:47,440 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47250, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 10:07:47,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1d0ad0dc to 127.0.0.1:55181 2023-07-23 10:07:47,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 10:07:47,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-23 10:07:47,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-23 10:07:47,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-23 10:07:47,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-23 10:07:47,450 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-23 10:07:47,451 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1690107467451 2023-07-23 10:07:47,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-23 10:07:47,451 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-23 10:07:47,452 DEBUG [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-23 10:07:47,453 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-23 10:07:47,453 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-23 10:07:47,453 DEBUG [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-23 10:07:47,456 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-07-23 10:07:47,459 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-23 10:07:47,460 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1690107467460 2023-07-23 10:07:47,478 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,478 INFO [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-23 10:07:47,478 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:07:47,480 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-23 10:07:47,480 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-23 10:07:47,481 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,481 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,484 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:07:47,484 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:07:47,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:07:47,485 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:07:47,485 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:07:47,485 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:07:47,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:07:47,485 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:07:47,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:07:47,491 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:07:47,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,492 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,492 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,492 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:07:47,492 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,492 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:07:47,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-23 10:07:47,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-23 10:07:47,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,493 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-23 10:07:47,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-23 10:07:47,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,493 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-23 10:07:47,493 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-23 10:07:47,493 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:07:47,494 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-23 10:07:47,499 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,500 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-23 10:07:47,500 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:07:47,500 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,500 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-23 10:07:47,504 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-23 10:07:47,504 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-23 10:07:47,504 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:07:47,500 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,505 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-23 10:07:47,504 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36827,1690106767853' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-23 10:07:47,505 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-23 10:07:47,506 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36599,1690106767729' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-23 10:07:47,505 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-23 10:07:47,506 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:07:47,507 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-23 10:07:47,507 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-23 10:07:47,507 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39563,1690106767800' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-23 10:07:47,508 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:07:47,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:07:47,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:07:47,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:07:47,510 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,510 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:07:47,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:07:47,510 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,510 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 10:07:47,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:07:47,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:07:47,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:07:47,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:07:47,512 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36599,1690106767729' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-23 10:07:47,512 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2658eca0[Count = 1] remaining members to acquire global barrier 2023-07-23 10:07:47,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:07:47,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:07:47,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:07:47,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:07:47,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:07:47,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:07:47,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:07:47,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:07:47,515 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39563,1690106767800' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-23 10:07:47,515 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2658eca0[Count = 0] remaining members to acquire global barrier 2023-07-23 10:07:47,515 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-23 10:07:47,515 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,516 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,516 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-23 10:07:47,517 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:07:47,517 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:07:47,517 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-23 10:07:47,518 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 10:07:47,519 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,519 DEBUG [rs(jenkins-hbase4.apache.org,39563,1690106767800)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1690106866766.7712d5fabb599457616052b8c259bdb8. 2023-07-23 10:07:47,519 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 10:07:47,519 DEBUG [rs(jenkins-hbase4.apache.org,39563,1690106767800)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1690106866766.7712d5fabb599457616052b8c259bdb8. started... 2023-07-23 10:07:47,520 DEBUG [rs(jenkins-hbase4.apache.org,39563,1690106767800)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7712d5fabb599457616052b8c259bdb8: 2023-07-23 10:07:47,520 DEBUG [rs(jenkins-hbase4.apache.org,39563,1690106767800)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1690106866766.7712d5fabb599457616052b8c259bdb8.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,520 DEBUG [rs(jenkins-hbase4.apache.org,39563,1690106767800)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 10:07:47,520 DEBUG [rs(jenkins-hbase4.apache.org,39563,1690106767800)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-23 10:07:47,524 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] zookeeper.ZKUtil(162): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,524 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,524 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,524 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 10:07:47,524 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-23 10:07:47,524 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] zookeeper.ZKUtil(162): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,524 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,525 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 10:07:47,525 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-23 10:07:47,525 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-23 10:07:47,525 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,36827,1690106767853' in zk 2023-07-23 10:07:47,526 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-23 10:07:47,526 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:07:47,526 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-23 10:07:47,532 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 10:07:47,532 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 10:07:47,532 DEBUG [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1690106866766.b025f903a9345cfef1f272bdb7becc56. 2023-07-23 10:07:47,533 DEBUG [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1690106866766.b025f903a9345cfef1f272bdb7becc56. started... 2023-07-23 10:07:47,533 DEBUG [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b025f903a9345cfef1f272bdb7becc56: 2023-07-23 10:07:47,533 DEBUG [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1690106866766.b025f903a9345cfef1f272bdb7becc56.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,533 DEBUG [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 10:07:47,533 DEBUG [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-23 10:07:47,554 DEBUG [rs(jenkins-hbase4.apache.org,39563,1690106767800)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1690106866766.7712d5fabb599457616052b8c259bdb8. completed. 2023-07-23 10:07:47,554 DEBUG [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 10:07:47,554 DEBUG [rs(jenkins-hbase4.apache.org,39563,1690106767800)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1690106866766.7712d5fabb599457616052b8c259bdb8. 2023-07-23 10:07:47,554 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 10:07:47,554 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 10:07:47,554 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:07:47,554 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-23 10:07:47,554 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39563,1690106767800' in zk 2023-07-23 10:07:47,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-23 10:07:47,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-23 10:07:47,556 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:07:47,557 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-23 10:07:47,557 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:07:47,557 DEBUG [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-23 10:07:47,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:07:47,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:07:47,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:07:47,557 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-23 10:07:47,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:07:47,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:07:47,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:07:47,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:07:47,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:07:47,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:07:47,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:07:47,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:07:47,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,39563,1690106767800': 2023-07-23 10:07:47,560 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39563,1690106767800' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-23 10:07:47,568 DEBUG [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1690106866766.b025f903a9345cfef1f272bdb7becc56. completed. 2023-07-23 10:07:47,568 DEBUG [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1690106866766.b025f903a9345cfef1f272bdb7becc56. 2023-07-23 10:07:47,568 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 10:07:47,568 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 10:07:47,568 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:07:47,568 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-23 10:07:47,568 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,36599,1690106767729' in zk 2023-07-23 10:07:47,569 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-23 10:07:47,570 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:07:47,570 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-23 10:07:47,571 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:07:47,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:07:47,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:07:47,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:07:47,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:07:47,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:07:47,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:07:47,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:07:47,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:07:47,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:07:47,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:07:47,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:07:47,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:07:47,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,36599,1690106767729': 2023-07-23 10:07:47,575 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36599,1690106767729' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-23 10:07:47,575 INFO [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-23 10:07:47,575 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-23 10:07:47,575 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-23 10:07:47,575 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,575 INFO [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-23 10:07:47,577 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,577 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,577 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:07:47,577 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:07:47,577 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,577 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,577 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,577 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:07:47,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:07:47,577 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,577 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:07:47,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:07:47,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,578 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:07:47,578 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:07:47,578 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:07:47,578 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:07:47,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:07:47,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:07:47,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:07:47,579 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:07:47,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:07:47,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,579 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:07:47,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:07:47,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:07:47,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:07:47,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:07:47,581 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:07:47,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,582 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:07:47,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:07:47,582 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:07:47,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:07:47,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:07:47,586 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:07:47,586 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:07:47,586 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:07:47,586 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:07:47,586 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:07:47,586 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,586 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:07:47,586 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,586 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:07:47,586 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:07:47,586 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:07:47,586 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:07:47,586 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:07:47,586 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:07:47,588 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:07:47,586 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-23 10:07:47,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:07:47,588 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,588 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:07:47,589 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-23 10:07:47,588 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:07:47,589 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,589 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:07:47,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:07:47,589 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:07:47,589 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:07:47,589 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:07:47,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:07:47,589 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,589 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:07:47,589 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:07:47,589 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,589 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:07:47,589 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-23 10:07:47,605 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,606 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,659 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,720 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-23 10:07:47,720 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,720 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,721 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1690106867451Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1690106867605 (+154 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1690106867605Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1690106867605Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1690106867621 (+16 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1690106867640 (+19 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1690106867720 (+80 ms) 2023-07-23 10:07:47,725 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-23 10:07:47,726 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 273 msec 2023-07-23 10:07:47,758 DEBUG [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 10:07:47,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-23 10:07:47,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-23 10:07:47,761 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36599] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1690106866766.b025f903a9345cfef1f272bdb7becc56. with WAL disabled. Data may be lost in the event of a crash. 2023-07-23 10:07:47,767 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39563] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1690106866766.7712d5fabb599457616052b8c259bdb8. with WAL disabled. Data may be lost in the event of a crash. 2023-07-23 10:07:47,770 DEBUG [Listener at jenkins-hbase4.apache.org/44565] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-23 10:07:47,770 DEBUG [Listener at jenkins-hbase4.apache.org/44565] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1690106866766.b025f903a9345cfef1f272bdb7becc56. 2023-07-23 10:07:47,770 INFO [Listener at jenkins-hbase4.apache.org/44565] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 10:07:47,780 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-23 10:07:47,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690106867781 (current time:1690106867781). 2023-07-23 10:07:47,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-23 10:07:47,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] zookeeper.ReadOnlyZKClient(139): Connect 0x248b35a2 to 127.0.0.1:55181 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 10:07:47,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7f8daa7e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 10:07:47,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 10:07:47,796 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47260, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 10:07:47,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x248b35a2 to 127.0.0.1:55181 2023-07-23 10:07:47,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 10:07:47,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] zookeeper.ReadOnlyZKClient(139): Connect 0x09cb867a to 127.0.0.1:55181 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 10:07:47,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@749084c4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 10:07:47,811 DEBUG [hconnection-0x66dc0e72-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 10:07:47,815 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47268, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 10:07:47,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x09cb867a to 127.0.0.1:55181 2023-07-23 10:07:47,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 10:07:47,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-23 10:07:47,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-23 10:07:47,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-23 10:07:47,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-23 10:07:47,830 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-23 10:07:47,831 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1690107467831 2023-07-23 10:07:47,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-23 10:07:47,831 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-23 10:07:47,831 DEBUG [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-23 10:07:47,833 DEBUG [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-23 10:07:47,837 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-23 10:07:47,838 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-23 10:07:47,839 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 9 msec 2023-07-23 10:07:47,840 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-23 10:07:47,841 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1690107467841 2023-07-23 10:07:47,856 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,856 INFO [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-23 10:07:47,856 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:07:47,858 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-23 10:07:47,858 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-23 10:07:47,858 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,858 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,860 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:07:47,860 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:07:47,860 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:07:47,860 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:07:47,860 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:07:47,860 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:07:47,860 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:07:47,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:07:47,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:07:47,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:07:47,860 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:07:47,860 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:07:47,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,862 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,862 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,862 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:07:47,862 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-23 10:07:47,862 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-23 10:07:47,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,863 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-23 10:07:47,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-23 10:07:47,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,863 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-23 10:07:47,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-23 10:07:47,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,863 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-23 10:07:47,864 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,864 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-23 10:07:47,864 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,864 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:07:47,865 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-23 10:07:47,865 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:07:47,866 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,866 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-23 10:07:47,866 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:07:47,871 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-23 10:07:47,871 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-23 10:07:47,871 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-23 10:07:47,871 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-23 10:07:47,871 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-23 10:07:47,871 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-23 10:07:47,871 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36827,1690106767853' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-23 10:07:47,871 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36599,1690106767729' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-23 10:07:47,871 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39563,1690106767800' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-23 10:07:47,873 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,873 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,874 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:07:47,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:07:47,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:07:47,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:07:47,874 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:07:47,874 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,874 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,875 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 10:07:47,874 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,875 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 10:07:47,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:07:47,875 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,875 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 10:07:47,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:07:47,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:07:47,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:07:47,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:07:47,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:07:47,882 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36599,1690106767729' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-23 10:07:47,882 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@57b280e2[Count = 1] remaining members to acquire global barrier 2023-07-23 10:07:47,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:07:47,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:07:47,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:07:47,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:07:47,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:07:47,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:07:47,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:07:47,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:07:47,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:07:47,885 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39563,1690106767800' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-23 10:07:47,885 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@57b280e2[Count = 0] remaining members to acquire global barrier 2023-07-23 10:07:47,885 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-23 10:07:47,885 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,889 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,889 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,889 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,889 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,889 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,889 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,889 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-23 10:07:47,890 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-23 10:07:47,890 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:07:47,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,890 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-23 10:07:47,890 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-23 10:07:47,890 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 10:07:47,890 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,36827,1690106767853' in zk 2023-07-23 10:07:47,890 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 10:07:47,890 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 10:07:47,890 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 10:07:47,890 DEBUG [rs(jenkins-hbase4.apache.org,39563,1690106767800)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1690106866766.7712d5fabb599457616052b8c259bdb8. 2023-07-23 10:07:47,890 DEBUG [rs(jenkins-hbase4.apache.org,39563,1690106767800)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1690106866766.7712d5fabb599457616052b8c259bdb8. started... 2023-07-23 10:07:47,890 DEBUG [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1690106866766.b025f903a9345cfef1f272bdb7becc56. 2023-07-23 10:07:47,890 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:07:47,890 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-23 10:07:47,890 DEBUG [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1690106866766.b025f903a9345cfef1f272bdb7becc56. started... 2023-07-23 10:07:47,891 INFO [rs(jenkins-hbase4.apache.org,39563,1690106767800)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 7712d5fabb599457616052b8c259bdb8 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-23 10:07:47,891 INFO [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] regionserver.HRegion(2745): Flushing b025f903a9345cfef1f272bdb7becc56 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-23 10:07:47,892 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-23 10:07:47,892 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:07:47,892 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-23 10:07:47,931 INFO [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307234bf8506500094e81bb4cebb6414d5c71 to hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202307234bf8506500094e81bb4cebb6414d5c71 2023-07-23 10:07:47,933 DEBUG [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 10:07:47,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-23 10:07:47,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-23 10:07:47,936 DEBUG [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-23 10:07:47,940 INFO [rs(jenkins-hbase4.apache.org,39563,1690106767800)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307235c596c7675e5468498875af44b64405b to hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202307235c596c7675e5468498875af44b64405b 2023-07-23 10:07:47,974 INFO [rs(jenkins-hbase4.apache.org,39563,1690106767800)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testEmptyExportFileSystemState/7712d5fabb599457616052b8c259bdb8/.tmp/cf/20a7a094715047ea82501d4a7e530b2d 2023-07-23 10:07:47,980 DEBUG [rs(jenkins-hbase4.apache.org,39563,1690106767800)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testEmptyExportFileSystemState/7712d5fabb599457616052b8c259bdb8/.tmp/cf/20a7a094715047ea82501d4a7e530b2d as hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testEmptyExportFileSystemState/7712d5fabb599457616052b8c259bdb8/cf/20a7a094715047ea82501d4a7e530b2d 2023-07-23 10:07:47,986 INFO [rs(jenkins-hbase4.apache.org,39563,1690106767800)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testEmptyExportFileSystemState/7712d5fabb599457616052b8c259bdb8/cf/20a7a094715047ea82501d4a7e530b2d, entries=45, sequenceid=6, filesize=12.7 K 2023-07-23 10:07:47,988 INFO [rs(jenkins-hbase4.apache.org,39563,1690106767800)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 7712d5fabb599457616052b8c259bdb8 in 97ms, sequenceid=6, compaction requested=false 2023-07-23 10:07:47,988 DEBUG [rs(jenkins-hbase4.apache.org,39563,1690106767800)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-23 10:07:47,989 DEBUG [rs(jenkins-hbase4.apache.org,39563,1690106767800)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7712d5fabb599457616052b8c259bdb8: 2023-07-23 10:07:47,990 DEBUG [rs(jenkins-hbase4.apache.org,39563,1690106767800)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1690106866766.7712d5fabb599457616052b8c259bdb8.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:47,991 DEBUG [rs(jenkins-hbase4.apache.org,39563,1690106767800)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 10:07:47,991 DEBUG [rs(jenkins-hbase4.apache.org,39563,1690106767800)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testEmptyExportFileSystemState/7712d5fabb599457616052b8c259bdb8/cf/20a7a094715047ea82501d4a7e530b2d] hfiles 2023-07-23 10:07:47,991 DEBUG [rs(jenkins-hbase4.apache.org,39563,1690106767800)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testEmptyExportFileSystemState/7712d5fabb599457616052b8c259bdb8/cf/20a7a094715047ea82501d4a7e530b2d for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,030 DEBUG [rs(jenkins-hbase4.apache.org,39563,1690106767800)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1690106866766.7712d5fabb599457616052b8c259bdb8. completed. 2023-07-23 10:07:48,031 DEBUG [rs(jenkins-hbase4.apache.org,39563,1690106767800)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1690106866766.7712d5fabb599457616052b8c259bdb8. 2023-07-23 10:07:48,031 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 10:07:48,031 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 10:07:48,031 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:07:48,031 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-23 10:07:48,031 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39563,1690106767800' in zk 2023-07-23 10:07:48,037 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:07:48,037 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-23 10:07:48,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:07:48,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:07:48,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:07:48,037 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:07:48,037 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-23 10:07:48,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:07:48,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:07:48,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:07:48,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:07:48,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:07:48,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:07:48,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:07:48,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:07:48,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,39563,1690106767800': 2023-07-23 10:07:48,048 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39563,1690106767800' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-23 10:07:48,136 DEBUG [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 10:07:48,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-23 10:07:48,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-23 10:07:48,137 DEBUG [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-23 10:07:48,350 INFO [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testEmptyExportFileSystemState/b025f903a9345cfef1f272bdb7becc56/.tmp/cf/0edf84c60c1c464e9e978c664e060e7b 2023-07-23 10:07:48,355 DEBUG [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testEmptyExportFileSystemState/b025f903a9345cfef1f272bdb7becc56/.tmp/cf/0edf84c60c1c464e9e978c664e060e7b as hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testEmptyExportFileSystemState/b025f903a9345cfef1f272bdb7becc56/cf/0edf84c60c1c464e9e978c664e060e7b 2023-07-23 10:07:48,360 INFO [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testEmptyExportFileSystemState/b025f903a9345cfef1f272bdb7becc56/cf/0edf84c60c1c464e9e978c664e060e7b, entries=5, sequenceid=6, filesize=5.8 K 2023-07-23 10:07:48,361 INFO [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for b025f903a9345cfef1f272bdb7becc56 in 470ms, sequenceid=6, compaction requested=false 2023-07-23 10:07:48,363 DEBUG [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b025f903a9345cfef1f272bdb7becc56: 2023-07-23 10:07:48,363 DEBUG [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1690106866766.b025f903a9345cfef1f272bdb7becc56.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,363 DEBUG [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 10:07:48,363 DEBUG [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testEmptyExportFileSystemState/b025f903a9345cfef1f272bdb7becc56/cf/0edf84c60c1c464e9e978c664e060e7b] hfiles 2023-07-23 10:07:48,363 DEBUG [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testEmptyExportFileSystemState/b025f903a9345cfef1f272bdb7becc56/cf/0edf84c60c1c464e9e978c664e060e7b for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,401 DEBUG [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1690106866766.b025f903a9345cfef1f272bdb7becc56. completed. 2023-07-23 10:07:48,401 DEBUG [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1690106866766.b025f903a9345cfef1f272bdb7becc56. 2023-07-23 10:07:48,401 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 10:07:48,401 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 10:07:48,401 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:07:48,401 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-23 10:07:48,401 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,36599,1690106767729' in zk 2023-07-23 10:07:48,424 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:07:48,424 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-23 10:07:48,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:07:48,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:07:48,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:07:48,424 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:07:48,424 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-23 10:07:48,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:07:48,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:07:48,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:07:48,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:07:48,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:07:48,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:07:48,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:07:48,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:07:48,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:07:48,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,36599,1690106767729': 2023-07-23 10:07:48,429 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36599,1690106767729' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-23 10:07:48,429 INFO [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-23 10:07:48,429 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-23 10:07:48,429 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-23 10:07:48,429 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,429 INFO [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-23 10:07:48,438 DEBUG [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 10:07:48,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-23 10:07:48,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-23 10:07:48,439 DEBUG [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-23 10:07:48,447 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,447 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,447 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,447 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:07:48,447 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:07:48,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:07:48,447 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:07:48,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,447 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:07:48,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:07:48,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:07:48,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:07:48,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:07:48,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:07:48,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:07:48,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:07:48,448 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:07:48,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,449 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:07:48,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:07:48,450 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:07:48,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:07:48,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:07:48,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:07:48,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:07:48,452 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:07:48,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,452 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:07:48,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:07:48,453 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:07:48,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:07:48,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:07:48,487 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:07:48,487 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:07:48,487 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:07:48,487 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:07:48,487 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:07:48,487 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:07:48,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:07:48,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:07:48,487 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:07:48,487 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,487 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:07:48,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:07:48,487 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:07:48,487 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:07:48,488 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,487 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:07:48,489 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-23 10:07:48,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:07:48,487 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:07:48,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:07:48,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:07:48,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:07:48,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:07:48,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:07:48,490 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,490 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:07:48,490 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-23 10:07:48,490 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,490 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:07:48,490 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,490 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:07:48,491 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:07:48,491 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,491 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,491 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202307235c596c7675e5468498875af44b64405b, hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202307234bf8506500094e81bb4cebb6414d5c71] mob files 2023-07-23 10:07:48,491 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202307235c596c7675e5468498875af44b64405b 2023-07-23 10:07:48,492 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202307234bf8506500094e81bb4cebb6414d5c71 2023-07-23 10:07:48,533 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,534 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:48,939 DEBUG [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 10:07:48,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-23 10:07:48,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-23 10:07:48,940 DEBUG [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-07-23 10:07:49,020 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:49,076 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-23 10:07:49,076 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:49,076 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:49,076 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1690106867831Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1690106868533 (+702 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1690106868533Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1690106868533Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1690106868539 (+6 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1690106869013 (+474 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1690106869076 (+63 ms) 2023-07-23 10:07:49,079 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-23 10:07:49,081 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 1.2460 sec 2023-07-23 10:07:49,941 DEBUG [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 10:07:49,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-23 10:07:49,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-23 10:07:49,942 INFO [Listener at jenkins-hbase4.apache.org/44565] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/export-test/export-1690106869942 2023-07-23 10:07:49,943 INFO [Listener at jenkins-hbase4.apache.org/44565] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:37479, tgtDir=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/export-test/export-1690106869942, rawTgtDir=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/export-test/export-1690106869942, srcFsUri=hdfs://localhost:37479, srcDir=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528 2023-07-23 10:07:49,977 DEBUG [Listener at jenkins-hbase4.apache.org/44565] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:37479, inputRoot=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528 2023-07-23 10:07:49,978 DEBUG [Listener at jenkins-hbase4.apache.org/44565] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1312042491_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/export-test/export-1690106869942, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/export-test/export-1690106869942/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:49,978 INFO [Listener at jenkins-hbase4.apache.org/44565] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:37479, inputRoot=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528, snapshotDir=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-23 10:07:49,994 INFO [Listener at jenkins-hbase4.apache.org/44565] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/export-test/export-1690106869942/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:07:50,092 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-23 10:07:50,092 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-23 10:07:50,093 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-23 10:07:50,093 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-23 10:07:50,094 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-23 10:07:50,094 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-23 10:07:50,095 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-23 10:07:50,202 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f0c2d64d-3350-bc69-1c38-d6964a44400f/hadoop-6222592035118962009.jar 2023-07-23 10:07:50,203 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-23 10:07:50,204 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-23 10:07:50,204 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-23 10:07:50,205 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-23 10:07:50,205 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-23 10:07:50,205 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-23 10:07:50,206 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-23 10:07:50,206 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-23 10:07:50,207 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-23 10:07:50,207 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-23 10:07:50,208 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-23 10:07:50,208 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-23 10:07:50,208 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-23 10:07:50,209 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-23 10:07:50,209 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-23 10:07:50,210 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-23 10:07:50,210 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 10:07:50,211 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 10:07:50,211 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 10:07:50,212 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 10:07:50,212 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 10:07:50,213 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 10:07:50,213 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 10:07:50,868 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690106775176_0005_000001 (auth:SIMPLE) 2023-07-23 10:07:51,601 WARN [Listener at jenkins-hbase4.apache.org/44565] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-23 10:07:51,605 INFO [Listener at jenkins-hbase4.apache.org/44565] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-23 10:07:51,692 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-23 10:07:51,893 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 10:07:51,893 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 10:07:52,657 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690106775176_0006_000001 (auth:SIMPLE) 2023-07-23 10:07:58,563 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690106775176_0006_000001 (auth:SIMPLE) 2023-07-23 10:08:01,207 INFO [Listener at jenkins-hbase4.apache.org/44565] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-23 10:08:01,208 INFO [Listener at jenkins-hbase4.apache.org/44565] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-23 10:08:01,215 INFO [Listener at jenkins-hbase4.apache.org/44565] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:08:01,215 INFO [Listener at jenkins-hbase4.apache.org/44565] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-23 10:08:01,216 INFO [Listener at jenkins-hbase4.apache.org/44565] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-23 10:08:01,216 DEBUG [Listener at jenkins-hbase4.apache.org/44565] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-165846724_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:08:01,216 DEBUG [Listener at jenkins-hbase4.apache.org/44565] snapshot.TestExportSnapshot(367): hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-23 10:08:01,216 DEBUG [Listener at jenkins-hbase4.apache.org/44565] snapshot.TestExportSnapshot(367): hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-23 10:08:01,216 DEBUG [Listener at jenkins-hbase4.apache.org/44565] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-165846724_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/export-test/export-1690106869942/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/export-test/export-1690106869942/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:08:01,217 DEBUG [Listener at jenkins-hbase4.apache.org/44565] snapshot.TestExportSnapshot(367): hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/export-test/export-1690106869942/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-23 10:08:01,217 DEBUG [Listener at jenkins-hbase4.apache.org/44565] snapshot.TestExportSnapshot(367): hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/export-test/export-1690106869942/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-23 10:08:01,223 INFO [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-23 10:08:01,223 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-07-23 10:08:01,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-23 10:08:01,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-23 10:08:01,229 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690106881229"}]},"ts":"1690106881229"} 2023-07-23 10:08:01,231 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-23 10:08:01,238 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-23 10:08:01,243 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=b025f903a9345cfef1f272bdb7becc56, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=7712d5fabb599457616052b8c259bdb8, UNASSIGN}] 2023-07-23 10:08:01,244 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=7712d5fabb599457616052b8c259bdb8, UNASSIGN 2023-07-23 10:08:01,246 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=b025f903a9345cfef1f272bdb7becc56, UNASSIGN 2023-07-23 10:08:01,247 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=7712d5fabb599457616052b8c259bdb8, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:08:01,247 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=b025f903a9345cfef1f272bdb7becc56, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:08:01,247 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1690106866766.7712d5fabb599457616052b8c259bdb8.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690106881247"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690106881247"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690106881247"}]},"ts":"1690106881247"} 2023-07-23 10:08:01,247 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1690106866766.b025f903a9345cfef1f272bdb7becc56.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690106881247"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690106881247"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690106881247"}]},"ts":"1690106881247"} 2023-07-23 10:08:01,249 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=101, state=RUNNABLE; CloseRegionProcedure 7712d5fabb599457616052b8c259bdb8, server=jenkins-hbase4.apache.org,39563,1690106767800}] 2023-07-23 10:08:01,250 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=100, state=RUNNABLE; CloseRegionProcedure b025f903a9345cfef1f272bdb7becc56, server=jenkins-hbase4.apache.org,36599,1690106767729}] 2023-07-23 10:08:01,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-23 10:08:01,402 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 7712d5fabb599457616052b8c259bdb8 2023-07-23 10:08:01,402 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7712d5fabb599457616052b8c259bdb8, disabling compactions & flushes 2023-07-23 10:08:01,402 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1690106866766.7712d5fabb599457616052b8c259bdb8. 2023-07-23 10:08:01,402 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1690106866766.7712d5fabb599457616052b8c259bdb8. 2023-07-23 10:08:01,402 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1690106866766.7712d5fabb599457616052b8c259bdb8. after waiting 0 ms 2023-07-23 10:08:01,402 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1690106866766.7712d5fabb599457616052b8c259bdb8. 2023-07-23 10:08:01,403 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close b025f903a9345cfef1f272bdb7becc56 2023-07-23 10:08:01,405 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b025f903a9345cfef1f272bdb7becc56, disabling compactions & flushes 2023-07-23 10:08:01,405 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1690106866766.b025f903a9345cfef1f272bdb7becc56. 2023-07-23 10:08:01,405 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1690106866766.b025f903a9345cfef1f272bdb7becc56. 2023-07-23 10:08:01,405 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1690106866766.b025f903a9345cfef1f272bdb7becc56. after waiting 0 ms 2023-07-23 10:08:01,405 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1690106866766.b025f903a9345cfef1f272bdb7becc56. 2023-07-23 10:08:01,448 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testEmptyExportFileSystemState/7712d5fabb599457616052b8c259bdb8/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-23 10:08:01,448 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 10:08:01,450 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1690106866766.7712d5fabb599457616052b8c259bdb8. 2023-07-23 10:08:01,451 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7712d5fabb599457616052b8c259bdb8: 2023-07-23 10:08:01,453 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 7712d5fabb599457616052b8c259bdb8 2023-07-23 10:08:01,453 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=7712d5fabb599457616052b8c259bdb8, regionState=CLOSED 2023-07-23 10:08:01,454 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1690106866766.7712d5fabb599457616052b8c259bdb8.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690106881453"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690106881453"}]},"ts":"1690106881453"} 2023-07-23 10:08:01,454 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testEmptyExportFileSystemState/b025f903a9345cfef1f272bdb7becc56/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-23 10:08:01,458 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=101 2023-07-23 10:08:01,458 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=101, state=SUCCESS; CloseRegionProcedure 7712d5fabb599457616052b8c259bdb8, server=jenkins-hbase4.apache.org,39563,1690106767800 in 206 msec 2023-07-23 10:08:01,459 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 10:08:01,461 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1690106866766.b025f903a9345cfef1f272bdb7becc56. 2023-07-23 10:08:01,461 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b025f903a9345cfef1f272bdb7becc56: 2023-07-23 10:08:01,461 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=7712d5fabb599457616052b8c259bdb8, UNASSIGN in 215 msec 2023-07-23 10:08:01,463 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed b025f903a9345cfef1f272bdb7becc56 2023-07-23 10:08:01,463 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=b025f903a9345cfef1f272bdb7becc56, regionState=CLOSED 2023-07-23 10:08:01,463 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1690106866766.b025f903a9345cfef1f272bdb7becc56.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690106881463"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690106881463"}]},"ts":"1690106881463"} 2023-07-23 10:08:01,474 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=100 2023-07-23 10:08:01,474 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=100, state=SUCCESS; CloseRegionProcedure b025f903a9345cfef1f272bdb7becc56, server=jenkins-hbase4.apache.org,36599,1690106767729 in 221 msec 2023-07-23 10:08:01,476 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=100, resume processing ppid=99 2023-07-23 10:08:01,476 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=b025f903a9345cfef1f272bdb7becc56, UNASSIGN in 231 msec 2023-07-23 10:08:01,478 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690106881478"}]},"ts":"1690106881478"} 2023-07-23 10:08:01,480 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-23 10:08:01,482 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-23 10:08:01,486 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 260 msec 2023-07-23 10:08:01,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-23 10:08:01,532 INFO [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-23 10:08:01,533 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-07-23 10:08:01,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-23 10:08:01,537 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-23 10:08:01,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-23 10:08:01,539 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-23 10:08:01,542 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39563] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-23 10:08:01,544 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testEmptyExportFileSystemState/7712d5fabb599457616052b8c259bdb8 2023-07-23 10:08:01,544 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testEmptyExportFileSystemState/b025f903a9345cfef1f272bdb7becc56 2023-07-23 10:08:01,545 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-23 10:08:01,545 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-23 10:08:01,546 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-23 10:08:01,546 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-23 10:08:01,546 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-23 10:08:01,547 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-23 10:08:01,547 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-23 10:08:01,548 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testEmptyExportFileSystemState/b025f903a9345cfef1f272bdb7becc56/cf, FileablePath, hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testEmptyExportFileSystemState/b025f903a9345cfef1f272bdb7becc56/recovered.edits] 2023-07-23 10:08:01,548 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testEmptyExportFileSystemState/7712d5fabb599457616052b8c259bdb8/cf, FileablePath, hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testEmptyExportFileSystemState/7712d5fabb599457616052b8c259bdb8/recovered.edits] 2023-07-23 10:08:01,549 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-23 10:08:01,549 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-23 10:08:01,550 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:08:01,550 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:08:01,550 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-23 10:08:01,550 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:08:01,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-23 10:08:01,551 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:08:01,551 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data null 2023-07-23 10:08:01,551 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-23 10:08:01,556 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testEmptyExportFileSystemState/7712d5fabb599457616052b8c259bdb8/cf/20a7a094715047ea82501d4a7e530b2d to hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/archive/data/default/testtb-testEmptyExportFileSystemState/7712d5fabb599457616052b8c259bdb8/cf/20a7a094715047ea82501d4a7e530b2d 2023-07-23 10:08:01,556 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testEmptyExportFileSystemState/b025f903a9345cfef1f272bdb7becc56/cf/0edf84c60c1c464e9e978c664e060e7b to hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/archive/data/default/testtb-testEmptyExportFileSystemState/b025f903a9345cfef1f272bdb7becc56/cf/0edf84c60c1c464e9e978c664e060e7b 2023-07-23 10:08:01,566 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testEmptyExportFileSystemState/7712d5fabb599457616052b8c259bdb8/recovered.edits/9.seqid to hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/archive/data/default/testtb-testEmptyExportFileSystemState/7712d5fabb599457616052b8c259bdb8/recovered.edits/9.seqid 2023-07-23 10:08:01,567 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testEmptyExportFileSystemState/7712d5fabb599457616052b8c259bdb8 2023-07-23 10:08:01,567 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testEmptyExportFileSystemState/b025f903a9345cfef1f272bdb7becc56/recovered.edits/9.seqid to hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/archive/data/default/testtb-testEmptyExportFileSystemState/b025f903a9345cfef1f272bdb7becc56/recovered.edits/9.seqid 2023-07-23 10:08:01,568 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testEmptyExportFileSystemState/b025f903a9345cfef1f272bdb7becc56 2023-07-23 10:08:01,568 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-23 10:08:01,568 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-23 10:08:01,569 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-07-23 10:08:01,579 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202307235c596c7675e5468498875af44b64405b to hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202307235c596c7675e5468498875af44b64405b 2023-07-23 10:08:01,582 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202307234bf8506500094e81bb4cebb6414d5c71 to hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202307234bf8506500094e81bb4cebb6414d5c71 2023-07-23 10:08:01,584 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-23 10:08:01,587 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-23 10:08:01,589 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-23 10:08:01,603 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-23 10:08:01,605 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-23 10:08:01,605 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-23 10:08:01,605 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1690106866766.b025f903a9345cfef1f272bdb7becc56.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690106881605"}]},"ts":"9223372036854775807"} 2023-07-23 10:08:01,605 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1690106866766.7712d5fabb599457616052b8c259bdb8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690106881605"}]},"ts":"9223372036854775807"} 2023-07-23 10:08:01,609 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-23 10:08:01,610 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => b025f903a9345cfef1f272bdb7becc56, NAME => 'testtb-testEmptyExportFileSystemState,,1690106866766.b025f903a9345cfef1f272bdb7becc56.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 7712d5fabb599457616052b8c259bdb8, NAME => 'testtb-testEmptyExportFileSystemState,1,1690106866766.7712d5fabb599457616052b8c259bdb8.', STARTKEY => '1', ENDKEY => ''}] 2023-07-23 10:08:01,610 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-23 10:08:01,610 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690106881610"}]},"ts":"9223372036854775807"} 2023-07-23 10:08:01,612 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-23 10:08:01,616 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-23 10:08:01,618 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 84 msec 2023-07-23 10:08:01,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-23 10:08:01,653 INFO [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-23 10:08:01,661 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-23 10:08:01,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 10:08:01,664 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-23 10:08:01,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-23 10:08:01,702 INFO [Listener at jenkins-hbase4.apache.org/44565] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=761 (was 760) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-165846724_17 at /127.0.0.1:57142 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3cfc6090-shared-pool-37 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3cfc6090-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-165846724_17 at /127.0.0.1:57982 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3cfc6090-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1894523085_1 at /127.0.0.1:44246 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3cfc6090-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1575588394) connection to jenkins-hbase4.apache.org/172.31.14.131:39681 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Thread-5026 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1894523085_1 at /127.0.0.1:39472 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1575588394) connection to jenkins-hbase4.apache.org/172.31.14.131:35421 from appattempt_1690106775176_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Parameter Sending Thread #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=922 (was 906) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=575 (was 492) - SystemLoadAverage LEAK? -, ProcessCount=180 (was 180), AvailableMemoryMB=5037 (was 5681) 2023-07-23 10:08:01,702 WARN [Listener at jenkins-hbase4.apache.org/44565] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-07-23 10:08:01,730 INFO [Listener at jenkins-hbase4.apache.org/44565] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=761, OpenFileDescriptor=922, MaxFileDescriptor=60000, SystemLoadAverage=575, ProcessCount=180, AvailableMemoryMB=5037 2023-07-23 10:08:01,731 WARN [Listener at jenkins-hbase4.apache.org/44565] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-07-23 10:08:01,733 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-23 10:08:01,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:01,736 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-23 10:08:01,737 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-23 10:08:01,737 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-23 10:08:01,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-23 10:08:01,740 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0f6f3a901c3a720e4b9ad8b65809ac42 2023-07-23 10:08:01,740 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/8cde33aaf05426c4bfbbd3d59234436b 2023-07-23 10:08:01,740 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/8cde33aaf05426c4bfbbd3d59234436b empty. 2023-07-23 10:08:01,740 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0f6f3a901c3a720e4b9ad8b65809ac42 empty. 2023-07-23 10:08:01,741 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/8cde33aaf05426c4bfbbd3d59234436b 2023-07-23 10:08:01,741 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0f6f3a901c3a720e4b9ad8b65809ac42 2023-07-23 10:08:01,741 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-23 10:08:01,758 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-23 10:08:01,760 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 0f6f3a901c3a720e4b9ad8b65809ac42, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1690106881733.0f6f3a901c3a720e4b9ad8b65809ac42.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp 2023-07-23 10:08:01,760 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 8cde33aaf05426c4bfbbd3d59234436b, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1690106881733.8cde33aaf05426c4bfbbd3d59234436b.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp 2023-07-23 10:08:01,811 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1690106881733.8cde33aaf05426c4bfbbd3d59234436b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 10:08:01,811 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 8cde33aaf05426c4bfbbd3d59234436b, disabling compactions & flushes 2023-07-23 10:08:01,811 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1690106881733.8cde33aaf05426c4bfbbd3d59234436b. 2023-07-23 10:08:01,811 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1690106881733.8cde33aaf05426c4bfbbd3d59234436b. 2023-07-23 10:08:01,811 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1690106881733.8cde33aaf05426c4bfbbd3d59234436b. after waiting 0 ms 2023-07-23 10:08:01,811 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1690106881733.8cde33aaf05426c4bfbbd3d59234436b. 2023-07-23 10:08:01,811 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1690106881733.8cde33aaf05426c4bfbbd3d59234436b. 2023-07-23 10:08:01,811 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 8cde33aaf05426c4bfbbd3d59234436b: 2023-07-23 10:08:01,820 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1690106881733.0f6f3a901c3a720e4b9ad8b65809ac42.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 10:08:01,820 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 0f6f3a901c3a720e4b9ad8b65809ac42, disabling compactions & flushes 2023-07-23 10:08:01,820 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1690106881733.0f6f3a901c3a720e4b9ad8b65809ac42. 2023-07-23 10:08:01,820 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1690106881733.0f6f3a901c3a720e4b9ad8b65809ac42. 2023-07-23 10:08:01,820 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1690106881733.0f6f3a901c3a720e4b9ad8b65809ac42. after waiting 0 ms 2023-07-23 10:08:01,820 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1690106881733.0f6f3a901c3a720e4b9ad8b65809ac42. 2023-07-23 10:08:01,820 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1690106881733.0f6f3a901c3a720e4b9ad8b65809ac42. 2023-07-23 10:08:01,820 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 0f6f3a901c3a720e4b9ad8b65809ac42: 2023-07-23 10:08:01,834 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-23 10:08:01,835 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690106881733.8cde33aaf05426c4bfbbd3d59234436b.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690106881835"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690106881835"}]},"ts":"1690106881835"} 2023-07-23 10:08:01,835 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690106881733.0f6f3a901c3a720e4b9ad8b65809ac42.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690106881835"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690106881835"}]},"ts":"1690106881835"} 2023-07-23 10:08:01,838 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-23 10:08:01,839 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-23 10:08:01,839 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690106881839"}]},"ts":"1690106881839"} 2023-07-23 10:08:01,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-23 10:08:01,840 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-23 10:08:01,846 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-23 10:08:01,847 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-23 10:08:01,848 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-23 10:08:01,848 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-23 10:08:01,848 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-23 10:08:01,848 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=0f6f3a901c3a720e4b9ad8b65809ac42, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=8cde33aaf05426c4bfbbd3d59234436b, ASSIGN}] 2023-07-23 10:08:01,851 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=8cde33aaf05426c4bfbbd3d59234436b, ASSIGN 2023-07-23 10:08:01,851 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=0f6f3a901c3a720e4b9ad8b65809ac42, ASSIGN 2023-07-23 10:08:01,854 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=8cde33aaf05426c4bfbbd3d59234436b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36599,1690106767729; forceNewPlan=false, retain=false 2023-07-23 10:08:01,854 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=0f6f3a901c3a720e4b9ad8b65809ac42, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36827,1690106767853; forceNewPlan=false, retain=false 2023-07-23 10:08:02,004 INFO [jenkins-hbase4:34097] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-23 10:08:02,008 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=0f6f3a901c3a720e4b9ad8b65809ac42, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:08:02,008 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690106881733.0f6f3a901c3a720e4b9ad8b65809ac42.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690106882007"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690106882007"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690106882007"}]},"ts":"1690106882007"} 2023-07-23 10:08:02,008 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=8cde33aaf05426c4bfbbd3d59234436b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:08:02,008 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690106881733.8cde33aaf05426c4bfbbd3d59234436b.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690106882008"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690106882008"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690106882008"}]},"ts":"1690106882008"} 2023-07-23 10:08:02,010 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=106, state=RUNNABLE; OpenRegionProcedure 0f6f3a901c3a720e4b9ad8b65809ac42, server=jenkins-hbase4.apache.org,36827,1690106767853}] 2023-07-23 10:08:02,011 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure 8cde33aaf05426c4bfbbd3d59234436b, server=jenkins-hbase4.apache.org,36599,1690106767729}] 2023-07-23 10:08:02,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-23 10:08:02,173 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1690106881733.8cde33aaf05426c4bfbbd3d59234436b. 2023-07-23 10:08:02,173 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8cde33aaf05426c4bfbbd3d59234436b, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1690106881733.8cde33aaf05426c4bfbbd3d59234436b.', STARTKEY => '1', ENDKEY => ''} 2023-07-23 10:08:02,174 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1690106881733.8cde33aaf05426c4bfbbd3d59234436b. service=AccessControlService 2023-07-23 10:08:02,174 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 10:08:02,174 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 8cde33aaf05426c4bfbbd3d59234436b 2023-07-23 10:08:02,174 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1690106881733.8cde33aaf05426c4bfbbd3d59234436b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 10:08:02,174 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 8cde33aaf05426c4bfbbd3d59234436b 2023-07-23 10:08:02,174 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 8cde33aaf05426c4bfbbd3d59234436b 2023-07-23 10:08:02,180 INFO [StoreOpener-8cde33aaf05426c4bfbbd3d59234436b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 8cde33aaf05426c4bfbbd3d59234436b 2023-07-23 10:08:02,183 DEBUG [StoreOpener-8cde33aaf05426c4bfbbd3d59234436b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemStateWithSkipTmp/8cde33aaf05426c4bfbbd3d59234436b/cf 2023-07-23 10:08:02,183 DEBUG [StoreOpener-8cde33aaf05426c4bfbbd3d59234436b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemStateWithSkipTmp/8cde33aaf05426c4bfbbd3d59234436b/cf 2023-07-23 10:08:02,184 INFO [StoreOpener-8cde33aaf05426c4bfbbd3d59234436b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8cde33aaf05426c4bfbbd3d59234436b columnFamilyName cf 2023-07-23 10:08:02,185 INFO [StoreOpener-8cde33aaf05426c4bfbbd3d59234436b-1] regionserver.HStore(310): Store=8cde33aaf05426c4bfbbd3d59234436b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 10:08:02,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemStateWithSkipTmp/8cde33aaf05426c4bfbbd3d59234436b 2023-07-23 10:08:02,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemStateWithSkipTmp/8cde33aaf05426c4bfbbd3d59234436b 2023-07-23 10:08:02,188 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1690106881733.0f6f3a901c3a720e4b9ad8b65809ac42. 2023-07-23 10:08:02,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0f6f3a901c3a720e4b9ad8b65809ac42, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1690106881733.0f6f3a901c3a720e4b9ad8b65809ac42.', STARTKEY => '', ENDKEY => '1'} 2023-07-23 10:08:02,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1690106881733.0f6f3a901c3a720e4b9ad8b65809ac42. service=AccessControlService 2023-07-23 10:08:02,189 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 10:08:02,189 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 0f6f3a901c3a720e4b9ad8b65809ac42 2023-07-23 10:08:02,189 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1690106881733.0f6f3a901c3a720e4b9ad8b65809ac42.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 10:08:02,189 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0f6f3a901c3a720e4b9ad8b65809ac42 2023-07-23 10:08:02,189 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0f6f3a901c3a720e4b9ad8b65809ac42 2023-07-23 10:08:02,190 INFO [StoreOpener-0f6f3a901c3a720e4b9ad8b65809ac42-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0f6f3a901c3a720e4b9ad8b65809ac42 2023-07-23 10:08:02,191 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 8cde33aaf05426c4bfbbd3d59234436b 2023-07-23 10:08:02,192 DEBUG [StoreOpener-0f6f3a901c3a720e4b9ad8b65809ac42-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemStateWithSkipTmp/0f6f3a901c3a720e4b9ad8b65809ac42/cf 2023-07-23 10:08:02,192 DEBUG [StoreOpener-0f6f3a901c3a720e4b9ad8b65809ac42-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemStateWithSkipTmp/0f6f3a901c3a720e4b9ad8b65809ac42/cf 2023-07-23 10:08:02,193 INFO [StoreOpener-0f6f3a901c3a720e4b9ad8b65809ac42-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0f6f3a901c3a720e4b9ad8b65809ac42 columnFamilyName cf 2023-07-23 10:08:02,193 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemStateWithSkipTmp/8cde33aaf05426c4bfbbd3d59234436b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 10:08:02,194 INFO [StoreOpener-0f6f3a901c3a720e4b9ad8b65809ac42-1] regionserver.HStore(310): Store=0f6f3a901c3a720e4b9ad8b65809ac42/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 10:08:02,194 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 8cde33aaf05426c4bfbbd3d59234436b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69340900, jitterRate=0.03325992822647095}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 10:08:02,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 8cde33aaf05426c4bfbbd3d59234436b: 2023-07-23 10:08:02,195 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1690106881733.8cde33aaf05426c4bfbbd3d59234436b., pid=109, masterSystemTime=1690106882164 2023-07-23 10:08:02,195 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemStateWithSkipTmp/0f6f3a901c3a720e4b9ad8b65809ac42 2023-07-23 10:08:02,196 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemStateWithSkipTmp/0f6f3a901c3a720e4b9ad8b65809ac42 2023-07-23 10:08:02,197 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1690106881733.8cde33aaf05426c4bfbbd3d59234436b. 2023-07-23 10:08:02,197 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1690106881733.8cde33aaf05426c4bfbbd3d59234436b. 2023-07-23 10:08:02,198 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=8cde33aaf05426c4bfbbd3d59234436b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:08:02,198 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690106881733.8cde33aaf05426c4bfbbd3d59234436b.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690106882198"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690106882198"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690106882198"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690106882198"}]},"ts":"1690106882198"} 2023-07-23 10:08:02,201 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0f6f3a901c3a720e4b9ad8b65809ac42 2023-07-23 10:08:02,208 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=107 2023-07-23 10:08:02,209 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure 8cde33aaf05426c4bfbbd3d59234436b, server=jenkins-hbase4.apache.org,36599,1690106767729 in 189 msec 2023-07-23 10:08:02,211 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=8cde33aaf05426c4bfbbd3d59234436b, ASSIGN in 361 msec 2023-07-23 10:08:02,212 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemStateWithSkipTmp/0f6f3a901c3a720e4b9ad8b65809ac42/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 10:08:02,212 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0f6f3a901c3a720e4b9ad8b65809ac42; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66258840, jitterRate=-0.01266634464263916}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 10:08:02,212 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0f6f3a901c3a720e4b9ad8b65809ac42: 2023-07-23 10:08:02,213 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1690106881733.0f6f3a901c3a720e4b9ad8b65809ac42., pid=108, masterSystemTime=1690106882162 2023-07-23 10:08:02,215 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1690106881733.0f6f3a901c3a720e4b9ad8b65809ac42. 2023-07-23 10:08:02,215 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1690106881733.0f6f3a901c3a720e4b9ad8b65809ac42. 2023-07-23 10:08:02,216 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=0f6f3a901c3a720e4b9ad8b65809ac42, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:08:02,216 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690106881733.0f6f3a901c3a720e4b9ad8b65809ac42.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690106882216"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690106882216"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690106882216"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690106882216"}]},"ts":"1690106882216"} 2023-07-23 10:08:02,221 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=106 2023-07-23 10:08:02,222 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=106, state=SUCCESS; OpenRegionProcedure 0f6f3a901c3a720e4b9ad8b65809ac42, server=jenkins-hbase4.apache.org,36827,1690106767853 in 208 msec 2023-07-23 10:08:02,223 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=106, resume processing ppid=105 2023-07-23 10:08:02,223 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=0f6f3a901c3a720e4b9ad8b65809ac42, ASSIGN in 374 msec 2023-07-23 10:08:02,225 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-23 10:08:02,225 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690106882225"}]},"ts":"1690106882225"} 2023-07-23 10:08:02,227 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-23 10:08:02,231 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-23 10:08:02,231 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-23 10:08:02,233 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39563] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-23 10:08:02,235 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:08:02,235 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:08:02,235 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:08:02,235 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:08:02,237 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-23 10:08:02,237 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-23 10:08:02,237 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-23 10:08:02,237 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-23 10:08:02,238 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 503 msec 2023-07-23 10:08:02,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-23 10:08:02,343 INFO [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-23 10:08:02,346 DEBUG [Listener at jenkins-hbase4.apache.org/44565] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,346 DEBUG [Listener at jenkins-hbase4.apache.org/44565] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1690106881733.0f6f3a901c3a720e4b9ad8b65809ac42. 2023-07-23 10:08:02,348 INFO [Listener at jenkins-hbase4.apache.org/44565] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 10:08:02,366 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-23 10:08:02,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690106882366 (current time:1690106882366). 2023-07-23 10:08:02,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-23 10:08:02,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] zookeeper.ReadOnlyZKClient(139): Connect 0x778b9305 to 127.0.0.1:55181 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 10:08:02,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@de17db5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 10:08:02,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 10:08:02,385 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33428, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 10:08:02,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x778b9305 to 127.0.0.1:55181 2023-07-23 10:08:02,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 10:08:02,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] zookeeper.ReadOnlyZKClient(139): Connect 0x0eab7e06 to 127.0.0.1:55181 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 10:08:02,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2513c76d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 10:08:02,400 DEBUG [hconnection-0x23991aaf-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 10:08:02,404 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33442, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 10:08:02,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0eab7e06 to 127.0.0.1:55181 2023-07-23 10:08:02,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 10:08:02,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-23 10:08:02,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-23 10:08:02,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-23 10:08:02,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-23 10:08:02,416 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-23 10:08:02,417 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1690107482417 2023-07-23 10:08:02,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-23 10:08:02,417 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,419 DEBUG [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-23 10:08:02,419 DEBUG [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-23 10:08:02,420 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-23 10:08:02,421 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-23 10:08:02,422 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 8 msec 2023-07-23 10:08:02,423 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-23 10:08:02,424 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1690107482424 2023-07-23 10:08:02,441 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,441 INFO [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-23 10:08:02,441 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:08:02,444 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-23 10:08:02,444 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-23 10:08:02,514 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,514 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,515 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:08:02,515 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:08:02,515 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:08:02,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:08:02,515 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:08:02,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:08:02,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,516 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,517 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-23 10:08:02,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,518 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-23 10:08:02,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-23 10:08:02,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,518 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,518 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-23 10:08:02,518 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-23 10:08:02,518 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:08:02,518 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,521 DEBUG [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 10:08:02,521 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-23 10:08:02,521 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-23 10:08:02,521 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-23 10:08:02,521 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:08:02,521 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36599,1690106767729' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-23 10:08:02,523 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-23 10:08:02,523 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-23 10:08:02,523 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36827,1690106767853' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-23 10:08:02,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-23 10:08:02,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-23 10:08:02,524 DEBUG [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-23 10:08:02,525 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:08:02,525 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:08:02,525 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:08:02,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:08:02,525 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:08:02,525 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:08:02,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,530 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:08:02,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:08:02,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:08:02,531 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:08:02,531 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,531 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,531 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 10:08:02,532 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,532 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,532 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 10:08:02,532 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:08:02,532 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36599,1690106767729' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-23 10:08:02,532 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3ab84d06[Count = 1] remaining members to acquire global barrier 2023-07-23 10:08:02,532 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-23 10:08:02,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-23 10:08:02,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:08:02,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,532 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-23 10:08:02,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:08:02,533 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,533 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-23 10:08:02,533 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:08:02,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,535 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-23 10:08:02,535 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-23 10:08:02,535 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39563,1690106767800' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-23 10:08:02,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:08:02,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:08:02,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:08:02,539 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,539 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36827,1690106767853' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-23 10:08:02,539 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3ab84d06[Count = 0] remaining members to acquire global barrier 2023-07-23 10:08:02,539 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-23 10:08:02,539 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,539 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,539 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 10:08:02,541 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,541 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,541 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,541 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,542 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,542 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-23 10:08:02,542 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,542 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-23 10:08:02,542 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-23 10:08:02,542 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,39563,1690106767800' in zk 2023-07-23 10:08:02,542 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-23 10:08:02,544 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 10:08:02,544 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 10:08:02,544 DEBUG [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1690106881733.8cde33aaf05426c4bfbbd3d59234436b. 2023-07-23 10:08:02,544 DEBUG [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1690106881733.8cde33aaf05426c4bfbbd3d59234436b. started... 2023-07-23 10:08:02,544 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 10:08:02,544 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 10:08:02,544 DEBUG [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1690106881733.0f6f3a901c3a720e4b9ad8b65809ac42. 2023-07-23 10:08:02,546 DEBUG [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8cde33aaf05426c4bfbbd3d59234436b: 2023-07-23 10:08:02,546 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-23 10:08:02,547 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:08:02,546 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:08:02,547 DEBUG [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1690106881733.8cde33aaf05426c4bfbbd3d59234436b.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,547 DEBUG [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 10:08:02,547 DEBUG [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-23 10:08:02,547 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-23 10:08:02,546 DEBUG [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1690106881733.0f6f3a901c3a720e4b9ad8b65809ac42. started... 2023-07-23 10:08:02,547 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:08:02,547 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-23 10:08:02,548 DEBUG [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0f6f3a901c3a720e4b9ad8b65809ac42: 2023-07-23 10:08:02,548 DEBUG [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1690106881733.0f6f3a901c3a720e4b9ad8b65809ac42.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,548 DEBUG [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 10:08:02,553 DEBUG [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-23 10:08:02,566 DEBUG [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1690106881733.8cde33aaf05426c4bfbbd3d59234436b. completed. 2023-07-23 10:08:02,566 DEBUG [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1690106881733.8cde33aaf05426c4bfbbd3d59234436b. 2023-07-23 10:08:02,566 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 10:08:02,567 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 10:08:02,567 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:08:02,567 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-23 10:08:02,567 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,36599,1690106767729' in zk 2023-07-23 10:08:02,570 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-23 10:08:02,570 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:08:02,570 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:08:02,570 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-23 10:08:02,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:08:02,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:08:02,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:08:02,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:08:02,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:08:02,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:08:02,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:08:02,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:08:02,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:08:02,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:08:02,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:08:02,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,36599,1690106767729': 2023-07-23 10:08:02,577 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36599,1690106767729' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-23 10:08:02,579 DEBUG [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1690106881733.0f6f3a901c3a720e4b9ad8b65809ac42. completed. 2023-07-23 10:08:02,579 DEBUG [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1690106881733.0f6f3a901c3a720e4b9ad8b65809ac42. 2023-07-23 10:08:02,579 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 10:08:02,579 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 10:08:02,579 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:08:02,579 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-23 10:08:02,579 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,36827,1690106767853' in zk 2023-07-23 10:08:02,581 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-23 10:08:02,581 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:08:02,581 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-23 10:08:02,581 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:08:02,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:08:02,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:08:02,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:08:02,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:08:02,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:08:02,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:08:02,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:08:02,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:08:02,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:08:02,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:08:02,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:08:02,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:08:02,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,36827,1690106767853': 2023-07-23 10:08:02,592 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36827,1690106767853' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-23 10:08:02,592 INFO [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-23 10:08:02,592 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-23 10:08:02,592 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-23 10:08:02,592 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,592 INFO [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-23 10:08:02,594 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,594 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,594 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,594 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,594 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:08:02,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:08:02,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:08:02,594 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:08:02,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,595 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:08:02,594 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:08:02,595 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:08:02,595 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:08:02,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:08:02,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:08:02,595 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:08:02,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:08:02,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:08:02,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,596 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:08:02,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,596 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:08:02,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:08:02,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:08:02,601 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:08:02,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:08:02,601 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:08:02,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:08:02,602 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:08:02,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:08:02,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:08:02,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:08:02,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:08:02,607 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:08:02,607 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:08:02,607 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:08:02,607 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:08:02,607 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:08:02,607 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:08:02,607 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:08:02,607 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:08:02,607 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:08:02,607 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,607 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:08:02,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:08:02,607 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:08:02,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:08:02,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:08:02,607 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:08:02,607 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,608 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:08:02,608 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,608 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:08:02,608 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:08:02,608 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,608 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,608 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:08:02,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:08:02,608 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:08:02,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:08:02,608 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:08:02,608 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,608 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,613 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,614 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-23 10:08:02,608 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:08:02,613 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp because node does not exist (not an error) 2023-07-23 10:08:02,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:08:02,614 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-23 10:08:02,646 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,647 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,694 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,724 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-23 10:08:02,724 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,724 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,724 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1690106882417Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1690106882646 (+229 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1690106882646Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1690106882646Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1690106882663 (+17 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1690106882683 (+20 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1690106882724 (+41 ms) 2023-07-23 10:08:02,724 DEBUG [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 10:08:02,728 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-23 10:08:02,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-23 10:08:02,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-23 10:08:02,732 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36599] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1690106881733.8cde33aaf05426c4bfbbd3d59234436b. with WAL disabled. Data may be lost in the event of a crash. 2023-07-23 10:08:02,737 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36827] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1690106881733.0f6f3a901c3a720e4b9ad8b65809ac42. with WAL disabled. Data may be lost in the event of a crash. 2023-07-23 10:08:02,738 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 309 msec 2023-07-23 10:08:02,740 DEBUG [Listener at jenkins-hbase4.apache.org/44565] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,740 DEBUG [Listener at jenkins-hbase4.apache.org/44565] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1690106881733.0f6f3a901c3a720e4b9ad8b65809ac42. 2023-07-23 10:08:02,740 INFO [Listener at jenkins-hbase4.apache.org/44565] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 10:08:02,751 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-23 10:08:02,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690106882752 (current time:1690106882752). 2023-07-23 10:08:02,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-23 10:08:02,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] zookeeper.ReadOnlyZKClient(139): Connect 0x4f94cda2 to 127.0.0.1:55181 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 10:08:02,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@24b3ea9d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 10:08:02,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 10:08:02,803 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33444, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 10:08:02,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4f94cda2 to 127.0.0.1:55181 2023-07-23 10:08:02,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 10:08:02,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] zookeeper.ReadOnlyZKClient(139): Connect 0x01133b44 to 127.0.0.1:55181 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 10:08:02,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@68030f19, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 10:08:02,816 DEBUG [hconnection-0x535fe786-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 10:08:02,817 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33460, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 10:08:02,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x01133b44 to 127.0.0.1:55181 2023-07-23 10:08:02,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 10:08:02,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-23 10:08:02,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-23 10:08:02,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-23 10:08:02,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-23 10:08:02,827 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-23 10:08:02,828 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1690107482828 2023-07-23 10:08:02,828 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-23 10:08:02,829 DEBUG [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-23 10:08:02,829 DEBUG [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-23 10:08:02,830 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-23 10:08:02,830 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-23 10:08:02,832 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 4 msec 2023-07-23 10:08:02,832 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-23 10:08:02,834 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1690107482834 2023-07-23 10:08:02,848 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,848 INFO [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-23 10:08:02,848 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:08:02,850 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-23 10:08:02,850 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-23 10:08:02,850 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,850 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,852 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:08:02,852 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:08:02,852 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:08:02,852 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:08:02,852 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:08:02,852 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:08:02,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:08:02,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:08:02,852 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:08:02,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:08:02,853 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:08:02,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,853 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:08:02,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,853 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,853 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,853 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:08:02,853 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-23 10:08:02,853 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-23 10:08:02,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-23 10:08:02,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,854 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-23 10:08:02,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-23 10:08:02,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,854 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-23 10:08:02,854 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-23 10:08:02,854 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,854 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,854 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-23 10:08:02,855 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-23 10:08:02,855 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,855 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:08:02,855 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:08:02,855 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-23 10:08:02,856 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 10:08:02,856 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-23 10:08:02,856 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-23 10:08:02,856 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39563,1690106767800' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-23 10:08:02,858 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-23 10:08:02,858 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-23 10:08:02,858 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-23 10:08:02,858 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-23 10:08:02,858 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36827,1690106767853' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-23 10:08:02,858 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36599,1690106767729' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-23 10:08:02,865 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,865 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,865 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 10:08:02,866 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:08:02,866 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:08:02,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:08:02,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:08:02,867 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,867 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:08:02,867 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:08:02,867 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 10:08:02,867 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,868 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 10:08:02,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:08:02,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:08:02,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:08:02,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:08:02,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:08:02,870 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36599,1690106767729' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-23 10:08:02,870 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@78344a1b[Count = 1] remaining members to acquire global barrier 2023-07-23 10:08:02,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:08:02,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:08:02,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:08:02,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:08:02,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:08:02,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:08:02,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:08:02,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:08:02,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:08:02,873 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36827,1690106767853' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-23 10:08:02,873 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@78344a1b[Count = 0] remaining members to acquire global barrier 2023-07-23 10:08:02,873 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-23 10:08:02,873 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,878 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,878 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,878 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,878 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-23 10:08:02,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,878 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:08:02,879 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-23 10:08:02,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:02,879 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-23 10:08:02,879 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-23 10:08:02,879 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 10:08:02,879 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 10:08:02,879 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,39563,1690106767800' in zk 2023-07-23 10:08:02,879 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 10:08:02,879 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 10:08:02,879 DEBUG [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1690106881733.8cde33aaf05426c4bfbbd3d59234436b. 2023-07-23 10:08:02,879 DEBUG [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1690106881733.8cde33aaf05426c4bfbbd3d59234436b. started... 2023-07-23 10:08:02,879 DEBUG [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1690106881733.0f6f3a901c3a720e4b9ad8b65809ac42. 2023-07-23 10:08:02,879 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:08:02,879 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-23 10:08:02,879 DEBUG [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1690106881733.0f6f3a901c3a720e4b9ad8b65809ac42. started... 2023-07-23 10:08:02,879 INFO [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 8cde33aaf05426c4bfbbd3d59234436b 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-23 10:08:02,879 INFO [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 0f6f3a901c3a720e4b9ad8b65809ac42 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-23 10:08:02,880 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-23 10:08:02,880 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:08:02,881 DEBUG [member: 'jenkins-hbase4.apache.org,39563,1690106767800' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-23 10:08:02,907 INFO [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230723a601bf608a49467f81f409cc2878477d to hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230723a601bf608a49467f81f409cc2878477d 2023-07-23 10:08:02,914 INFO [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023072310ab6c089e4b48c9bcd01fcf6398bec2 to hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023072310ab6c089e4b48c9bcd01fcf6398bec2 2023-07-23 10:08:02,930 DEBUG [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 10:08:02,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-23 10:08:02,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-23 10:08:02,932 DEBUG [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-23 10:08:03,005 INFO [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemStateWithSkipTmp/0f6f3a901c3a720e4b9ad8b65809ac42/.tmp/cf/0ec69b557c894251b7688928482a49c5 2023-07-23 10:08:03,006 INFO [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemStateWithSkipTmp/8cde33aaf05426c4bfbbd3d59234436b/.tmp/cf/9aa2f0c7fb9547a3b06b4df922238ad1 2023-07-23 10:08:03,016 DEBUG [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemStateWithSkipTmp/0f6f3a901c3a720e4b9ad8b65809ac42/.tmp/cf/0ec69b557c894251b7688928482a49c5 as hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemStateWithSkipTmp/0f6f3a901c3a720e4b9ad8b65809ac42/cf/0ec69b557c894251b7688928482a49c5 2023-07-23 10:08:03,018 DEBUG [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemStateWithSkipTmp/8cde33aaf05426c4bfbbd3d59234436b/.tmp/cf/9aa2f0c7fb9547a3b06b4df922238ad1 as hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemStateWithSkipTmp/8cde33aaf05426c4bfbbd3d59234436b/cf/9aa2f0c7fb9547a3b06b4df922238ad1 2023-07-23 10:08:03,023 INFO [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemStateWithSkipTmp/8cde33aaf05426c4bfbbd3d59234436b/cf/9aa2f0c7fb9547a3b06b4df922238ad1, entries=45, sequenceid=6, filesize=13.0 K 2023-07-23 10:08:03,023 INFO [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemStateWithSkipTmp/0f6f3a901c3a720e4b9ad8b65809ac42/cf/0ec69b557c894251b7688928482a49c5, entries=5, sequenceid=6, filesize=5.8 K 2023-07-23 10:08:03,024 INFO [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 0f6f3a901c3a720e4b9ad8b65809ac42 in 145ms, sequenceid=6, compaction requested=false 2023-07-23 10:08:03,024 INFO [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 8cde33aaf05426c4bfbbd3d59234436b in 145ms, sequenceid=6, compaction requested=false 2023-07-23 10:08:03,025 DEBUG [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-23 10:08:03,025 DEBUG [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-23 10:08:03,028 DEBUG [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0f6f3a901c3a720e4b9ad8b65809ac42: 2023-07-23 10:08:03,029 DEBUG [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1690106881733.0f6f3a901c3a720e4b9ad8b65809ac42.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:03,029 DEBUG [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 10:08:03,029 DEBUG [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemStateWithSkipTmp/0f6f3a901c3a720e4b9ad8b65809ac42/cf/0ec69b557c894251b7688928482a49c5] hfiles 2023-07-23 10:08:03,029 DEBUG [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemStateWithSkipTmp/0f6f3a901c3a720e4b9ad8b65809ac42/cf/0ec69b557c894251b7688928482a49c5 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:03,043 DEBUG [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8cde33aaf05426c4bfbbd3d59234436b: 2023-07-23 10:08:03,043 DEBUG [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1690106881733.8cde33aaf05426c4bfbbd3d59234436b.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:03,043 DEBUG [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 10:08:03,043 DEBUG [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemStateWithSkipTmp/8cde33aaf05426c4bfbbd3d59234436b/cf/9aa2f0c7fb9547a3b06b4df922238ad1] hfiles 2023-07-23 10:08:03,043 DEBUG [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemStateWithSkipTmp/8cde33aaf05426c4bfbbd3d59234436b/cf/9aa2f0c7fb9547a3b06b4df922238ad1 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:03,073 DEBUG [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1690106881733.0f6f3a901c3a720e4b9ad8b65809ac42. completed. 2023-07-23 10:08:03,073 DEBUG [rs(jenkins-hbase4.apache.org,36827,1690106767853)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1690106881733.0f6f3a901c3a720e4b9ad8b65809ac42. 2023-07-23 10:08:03,073 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 10:08:03,073 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 10:08:03,073 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:08:03,073 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-23 10:08:03,073 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,36827,1690106767853' in zk 2023-07-23 10:08:03,076 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:08:03,076 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-23 10:08:03,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:08:03,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:08:03,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:08:03,076 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:08:03,077 DEBUG [member: 'jenkins-hbase4.apache.org,36827,1690106767853' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-23 10:08:03,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:08:03,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:08:03,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:03,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:08:03,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:08:03,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:08:03,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:08:03,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:03,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:08:03,087 DEBUG [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1690106881733.8cde33aaf05426c4bfbbd3d59234436b. completed. 2023-07-23 10:08:03,087 DEBUG [rs(jenkins-hbase4.apache.org,36599,1690106767729)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1690106881733.8cde33aaf05426c4bfbbd3d59234436b. 2023-07-23 10:08:03,087 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 10:08:03,087 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 10:08:03,087 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:08:03,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:08:03,087 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-23 10:08:03,088 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,36599,1690106767729' in zk 2023-07-23 10:08:03,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,36827,1690106767853': 2023-07-23 10:08:03,088 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36827,1690106767853' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-23 10:08:03,091 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-23 10:08:03,091 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:08:03,091 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:08:03,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:08:03,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:08:03,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:08:03,091 DEBUG [member: 'jenkins-hbase4.apache.org,36599,1690106767729' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-23 10:08:03,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:08:03,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:08:03,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:03,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:08:03,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:08:03,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:08:03,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:08:03,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:03,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:08:03,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:08:03,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:08:03,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,36599,1690106767729': 2023-07-23 10:08:03,098 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36599,1690106767729' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-23 10:08:03,098 INFO [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-23 10:08:03,098 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-23 10:08:03,099 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-23 10:08:03,099 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:03,099 INFO [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-23 10:08:03,104 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:03,104 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:03,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:03,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 10:08:03,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 10:08:03,104 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:03,104 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:03,105 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:08:03,105 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:03,105 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:08:03,104 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:03,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:03,104 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:08:03,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:03,105 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:03,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:03,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 10:08:03,105 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:08:03,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:08:03,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:03,107 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:08:03,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:08:03,107 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:08:03,107 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:08:03,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:08:03,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:03,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:03,107 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:08:03,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:03,108 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:08:03,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 10:08:03,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:03,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:08:03,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:08:03,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:08:03,114 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:08:03,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 10:08:03,114 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:08:03,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:03,115 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:08:03,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:08:03,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:08:03,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:08:03,121 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:08:03,121 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:08:03,121 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:08:03,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:08:03,121 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:08:03,121 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:08:03,121 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:08:03,121 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:03,121 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:08:03,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:08:03,121 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:08:03,121 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:08:03,122 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:03,122 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:08:03,122 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:03,122 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:08:03,122 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:08:03,122 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:08:03,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:08:03,122 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 10:08:03,122 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:03,122 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:03,123 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:03,122 DEBUG [(jenkins-hbase4.apache.org,34097,1690106766220)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 10:08:03,123 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:03,122 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:08:03,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:08:03,123 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-23 10:08:03,123 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:03,123 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 10:08:03,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 10:08:03,123 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 10:08:03,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 10:08:03,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 10:08:03,126 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023072310ab6c089e4b48c9bcd01fcf6398bec2, hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230723a601bf608a49467f81f409cc2878477d] mob files 2023-07-23 10:08:03,126 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023072310ab6c089e4b48c9bcd01fcf6398bec2 2023-07-23 10:08:03,126 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230723a601bf608a49467f81f409cc2878477d 2023-07-23 10:08:03,132 DEBUG [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 10:08:03,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-23 10:08:03,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-23 10:08:03,134 DEBUG [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-23 10:08:03,198 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:03,199 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:03,238 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:03,262 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-23 10:08:03,263 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:03,263 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:03,263 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1690106882828Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1690106883198 (+370 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1690106883198Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1690106883198Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1690106883208 (+10 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1690106883231 (+23 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1690106883262 (+31 ms) 2023-07-23 10:08:03,267 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-23 10:08:03,268 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 438 msec 2023-07-23 10:08:03,434 DEBUG [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 10:08:03,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-23 10:08:03,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-23 10:08:03,435 INFO [Listener at jenkins-hbase4.apache.org/44565] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/export-test/export-1690106883435 2023-07-23 10:08:03,436 INFO [Listener at jenkins-hbase4.apache.org/44565] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:37479, tgtDir=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/export-test/export-1690106883435, rawTgtDir=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/export-test/export-1690106883435, srcFsUri=hdfs://localhost:37479, srcDir=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528 2023-07-23 10:08:03,463 DEBUG [Listener at jenkins-hbase4.apache.org/44565] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:37479, inputRoot=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528 2023-07-23 10:08:03,463 DEBUG [Listener at jenkins-hbase4.apache.org/44565] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1241578032_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/export-test/export-1690106883435, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/export-test/export-1690106883435/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:03,463 INFO [Listener at jenkins-hbase4.apache.org/44565] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:37479, inputRoot=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528, snapshotDir=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-23 10:08:03,479 INFO [Listener at jenkins-hbase4.apache.org/44565] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/export-test/export-1690106883435/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:03,505 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-23 10:08:03,506 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-23 10:08:03,507 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-23 10:08:03,507 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-23 10:08:03,507 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-23 10:08:03,508 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-23 10:08:03,508 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-23 10:08:03,595 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f0c2d64d-3350-bc69-1c38-d6964a44400f/hadoop-6357310242743309640.jar 2023-07-23 10:08:03,596 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-23 10:08:03,596 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-23 10:08:03,596 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-23 10:08:03,597 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-23 10:08:03,597 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-23 10:08:03,597 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-23 10:08:03,597 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-23 10:08:03,598 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-23 10:08:03,598 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-23 10:08:03,599 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-23 10:08:03,599 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-23 10:08:03,599 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-23 10:08:03,600 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-23 10:08:03,600 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-23 10:08:03,600 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-23 10:08:03,600 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-23 10:08:03,601 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 10:08:03,601 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 10:08:03,602 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 10:08:03,602 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 10:08:03,602 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 10:08:03,602 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 10:08:03,603 DEBUG [Listener at jenkins-hbase4.apache.org/44565] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 10:08:04,208 WARN [Listener at jenkins-hbase4.apache.org/44565] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-23 10:08:04,210 INFO [Listener at jenkins-hbase4.apache.org/44565] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-23 10:08:04,213 DEBUG [Listener at jenkins-hbase4.apache.org/44565] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-07-23 10:08:05,945 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 10:08:05,945 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 10:08:05,947 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690106775176_0006_000001 (auth:SIMPLE) 2023-07-23 10:08:06,862 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690106775176_0007_000001 (auth:SIMPLE) 2023-07-23 10:08:07,042 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-23 10:08:13,098 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690106775176_0007_000001 (auth:SIMPLE) 2023-07-23 10:08:15,493 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690106775176_0007_000001 (auth:SIMPLE) 2023-07-23 10:08:19,665 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690106775176_0007_000001 (auth:SIMPLE) 2023-07-23 10:08:21,486 INFO [Listener at jenkins-hbase4.apache.org/44565] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-23 10:08:21,486 INFO [Listener at jenkins-hbase4.apache.org/44565] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-23 10:08:21,497 INFO [Listener at jenkins-hbase4.apache.org/44565] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:21,498 INFO [Listener at jenkins-hbase4.apache.org/44565] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-23 10:08:21,498 INFO [Listener at jenkins-hbase4.apache.org/44565] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-23 10:08:21,498 DEBUG [Listener at jenkins-hbase4.apache.org/44565] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-165846724_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:21,499 DEBUG [Listener at jenkins-hbase4.apache.org/44565] snapshot.TestExportSnapshot(367): hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-23 10:08:21,499 DEBUG [Listener at jenkins-hbase4.apache.org/44565] snapshot.TestExportSnapshot(367): hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-23 10:08:21,499 DEBUG [Listener at jenkins-hbase4.apache.org/44565] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-165846724_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/export-test/export-1690106883435/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/export-test/export-1690106883435/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:21,500 DEBUG [Listener at jenkins-hbase4.apache.org/44565] snapshot.TestExportSnapshot(367): hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/export-test/export-1690106883435/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-23 10:08:21,500 DEBUG [Listener at jenkins-hbase4.apache.org/44565] snapshot.TestExportSnapshot(367): hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/export-test/export-1690106883435/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-23 10:08:21,506 INFO [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:21,506 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:21,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:21,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-23 10:08:21,510 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690106901510"}]},"ts":"1690106901510"} 2023-07-23 10:08:21,512 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-23 10:08:21,513 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-23 10:08:21,514 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=0f6f3a901c3a720e4b9ad8b65809ac42, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=8cde33aaf05426c4bfbbd3d59234436b, UNASSIGN}] 2023-07-23 10:08:21,516 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=0f6f3a901c3a720e4b9ad8b65809ac42, UNASSIGN 2023-07-23 10:08:21,516 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=8cde33aaf05426c4bfbbd3d59234436b, UNASSIGN 2023-07-23 10:08:21,518 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=0f6f3a901c3a720e4b9ad8b65809ac42, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:08:21,518 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=8cde33aaf05426c4bfbbd3d59234436b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:08:21,518 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690106881733.0f6f3a901c3a720e4b9ad8b65809ac42.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690106901518"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690106901518"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690106901518"}]},"ts":"1690106901518"} 2023-07-23 10:08:21,518 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690106881733.8cde33aaf05426c4bfbbd3d59234436b.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690106901518"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690106901518"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690106901518"}]},"ts":"1690106901518"} 2023-07-23 10:08:21,519 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure 0f6f3a901c3a720e4b9ad8b65809ac42, server=jenkins-hbase4.apache.org,36827,1690106767853}] 2023-07-23 10:08:21,520 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure 8cde33aaf05426c4bfbbd3d59234436b, server=jenkins-hbase4.apache.org,36599,1690106767729}] 2023-07-23 10:08:21,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-23 10:08:21,671 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 0f6f3a901c3a720e4b9ad8b65809ac42 2023-07-23 10:08:21,671 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0f6f3a901c3a720e4b9ad8b65809ac42, disabling compactions & flushes 2023-07-23 10:08:21,671 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1690106881733.0f6f3a901c3a720e4b9ad8b65809ac42. 2023-07-23 10:08:21,671 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1690106881733.0f6f3a901c3a720e4b9ad8b65809ac42. 2023-07-23 10:08:21,671 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1690106881733.0f6f3a901c3a720e4b9ad8b65809ac42. after waiting 0 ms 2023-07-23 10:08:21,671 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1690106881733.0f6f3a901c3a720e4b9ad8b65809ac42. 2023-07-23 10:08:21,672 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 8cde33aaf05426c4bfbbd3d59234436b 2023-07-23 10:08:21,672 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 8cde33aaf05426c4bfbbd3d59234436b, disabling compactions & flushes 2023-07-23 10:08:21,672 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1690106881733.8cde33aaf05426c4bfbbd3d59234436b. 2023-07-23 10:08:21,672 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1690106881733.8cde33aaf05426c4bfbbd3d59234436b. 2023-07-23 10:08:21,672 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1690106881733.8cde33aaf05426c4bfbbd3d59234436b. after waiting 0 ms 2023-07-23 10:08:21,672 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1690106881733.8cde33aaf05426c4bfbbd3d59234436b. 2023-07-23 10:08:21,720 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemStateWithSkipTmp/0f6f3a901c3a720e4b9ad8b65809ac42/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-23 10:08:21,721 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 10:08:21,722 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1690106881733.0f6f3a901c3a720e4b9ad8b65809ac42. 2023-07-23 10:08:21,722 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0f6f3a901c3a720e4b9ad8b65809ac42: 2023-07-23 10:08:21,722 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/default/testtb-testExportFileSystemStateWithSkipTmp/8cde33aaf05426c4bfbbd3d59234436b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-23 10:08:21,723 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 10:08:21,724 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1690106881733.8cde33aaf05426c4bfbbd3d59234436b. 2023-07-23 10:08:21,724 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 8cde33aaf05426c4bfbbd3d59234436b: 2023-07-23 10:08:21,725 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 0f6f3a901c3a720e4b9ad8b65809ac42 2023-07-23 10:08:21,729 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=0f6f3a901c3a720e4b9ad8b65809ac42, regionState=CLOSED 2023-07-23 10:08:21,729 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690106881733.0f6f3a901c3a720e4b9ad8b65809ac42.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690106901729"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690106901729"}]},"ts":"1690106901729"} 2023-07-23 10:08:21,729 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 8cde33aaf05426c4bfbbd3d59234436b 2023-07-23 10:08:21,730 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=8cde33aaf05426c4bfbbd3d59234436b, regionState=CLOSED 2023-07-23 10:08:21,730 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690106881733.8cde33aaf05426c4bfbbd3d59234436b.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690106901730"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690106901730"}]},"ts":"1690106901730"} 2023-07-23 10:08:21,735 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=115 2023-07-23 10:08:21,735 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure 0f6f3a901c3a720e4b9ad8b65809ac42, server=jenkins-hbase4.apache.org,36827,1690106767853 in 213 msec 2023-07-23 10:08:21,736 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=116 2023-07-23 10:08:21,736 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure 8cde33aaf05426c4bfbbd3d59234436b, server=jenkins-hbase4.apache.org,36599,1690106767729 in 214 msec 2023-07-23 10:08:21,737 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=0f6f3a901c3a720e4b9ad8b65809ac42, UNASSIGN in 221 msec 2023-07-23 10:08:21,739 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=116, resume processing ppid=114 2023-07-23 10:08:21,739 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=8cde33aaf05426c4bfbbd3d59234436b, UNASSIGN in 222 msec 2023-07-23 10:08:21,739 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690106901739"}]},"ts":"1690106901739"} 2023-07-23 10:08:21,740 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-23 10:08:21,743 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-23 10:08:21,744 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 238 msec 2023-07-23 10:08:21,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-23 10:08:21,813 INFO [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-23 10:08:21,815 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:21,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:21,819 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:21,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:21,820 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:21,823 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39563] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:21,826 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:21,826 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:21,826 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:21,826 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:21,826 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-23 10:08:21,827 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-23 10:08:21,827 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-23 10:08:21,829 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:21,829 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:08:21,829 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:21,829 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:08:21,829 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:08:21,829 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:21,829 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 10:08:21,829 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data null 2023-07-23 10:08:21,829 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-23 10:08:21,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-23 10:08:21,831 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0f6f3a901c3a720e4b9ad8b65809ac42 2023-07-23 10:08:21,834 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0f6f3a901c3a720e4b9ad8b65809ac42/cf, FileablePath, hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0f6f3a901c3a720e4b9ad8b65809ac42/recovered.edits] 2023-07-23 10:08:21,838 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0f6f3a901c3a720e4b9ad8b65809ac42/cf/0ec69b557c894251b7688928482a49c5 to hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/0f6f3a901c3a720e4b9ad8b65809ac42/cf/0ec69b557c894251b7688928482a49c5 2023-07-23 10:08:21,846 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/8cde33aaf05426c4bfbbd3d59234436b 2023-07-23 10:08:21,848 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0f6f3a901c3a720e4b9ad8b65809ac42/recovered.edits/9.seqid to hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/0f6f3a901c3a720e4b9ad8b65809ac42/recovered.edits/9.seqid 2023-07-23 10:08:21,849 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/8cde33aaf05426c4bfbbd3d59234436b/cf, FileablePath, hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/8cde33aaf05426c4bfbbd3d59234436b/recovered.edits] 2023-07-23 10:08:21,849 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0f6f3a901c3a720e4b9ad8b65809ac42 2023-07-23 10:08:21,853 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/8cde33aaf05426c4bfbbd3d59234436b/cf/9aa2f0c7fb9547a3b06b4df922238ad1 to hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/8cde33aaf05426c4bfbbd3d59234436b/cf/9aa2f0c7fb9547a3b06b4df922238ad1 2023-07-23 10:08:21,857 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/8cde33aaf05426c4bfbbd3d59234436b/recovered.edits/9.seqid to hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/8cde33aaf05426c4bfbbd3d59234436b/recovered.edits/9.seqid 2023-07-23 10:08:21,858 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/8cde33aaf05426c4bfbbd3d59234436b 2023-07-23 10:08:21,858 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-23 10:08:21,858 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-23 10:08:21,859 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-07-23 10:08:21,864 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023072310ab6c089e4b48c9bcd01fcf6398bec2 to hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023072310ab6c089e4b48c9bcd01fcf6398bec2 2023-07-23 10:08:21,865 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230723a601bf608a49467f81f409cc2878477d to hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230723a601bf608a49467f81f409cc2878477d 2023-07-23 10:08:21,866 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-23 10:08:21,869 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:21,871 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-23 10:08:21,876 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-23 10:08:21,878 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:21,878 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-23 10:08:21,878 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690106881733.0f6f3a901c3a720e4b9ad8b65809ac42.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690106901878"}]},"ts":"9223372036854775807"} 2023-07-23 10:08:21,878 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690106881733.8cde33aaf05426c4bfbbd3d59234436b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690106901878"}]},"ts":"9223372036854775807"} 2023-07-23 10:08:21,880 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-23 10:08:21,880 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 0f6f3a901c3a720e4b9ad8b65809ac42, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1690106881733.0f6f3a901c3a720e4b9ad8b65809ac42.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 8cde33aaf05426c4bfbbd3d59234436b, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1690106881733.8cde33aaf05426c4bfbbd3d59234436b.', STARTKEY => '1', ENDKEY => ''}] 2023-07-23 10:08:21,880 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-23 10:08:21,880 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690106901880"}]},"ts":"9223372036854775807"} 2023-07-23 10:08:21,884 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-23 10:08:21,887 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:21,889 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 72 msec 2023-07-23 10:08:21,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-23 10:08:21,932 INFO [Listener at jenkins-hbase4.apache.org/44565] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-23 10:08:21,940 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-23 10:08:21,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:21,943 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-23 10:08:21,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34097] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 10:08:21,976 INFO [Listener at jenkins-hbase4.apache.org/44565] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=763 (was 761) Potentially hanging thread: ContainersLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3cfc6090-shared-pool-40 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-165846724_17 at /127.0.0.1:34384 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3cfc6090-shared-pool-41 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1076510437_1 at /127.0.0.1:37312 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1575588394) connection to jenkins-hbase4.apache.org/172.31.14.131:37685 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-165846724_17 at /127.0.0.1:58454 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3cfc6090-shared-pool-42 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3cfc6090-shared-pool-43 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-165846724_17 at /127.0.0.1:57968 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5669 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) - Thread LEAK? -, OpenFileDescriptor=904 (was 922), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=620 (was 575) - SystemLoadAverage LEAK? -, ProcessCount=178 (was 180), AvailableMemoryMB=5106 (was 5037) - AvailableMemoryMB LEAK? - 2023-07-23 10:08:21,976 WARN [Listener at jenkins-hbase4.apache.org/44565] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-07-23 10:08:21,976 INFO [Listener at jenkins-hbase4.apache.org/44565] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-23 10:08:21,987 INFO [Listener at jenkins-hbase4.apache.org/44565] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-23 10:08:22,100 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1690106775176_0007_01_000001 is : 143 2023-07-23 10:08:27,317 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-23 10:08:36,118 INFO [Listener at jenkins-hbase4.apache.org/44565] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-23 10:08:50,241 ERROR [Thread[Thread-409,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-23 10:08:50,243 INFO [Listener at jenkins-hbase4.apache.org/44565] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-23 10:08:50,361 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-23 10:08:50,377 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-23 10:08:50,378 ERROR [Thread[Thread-419,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-23 10:08:50,424 INFO [Listener at jenkins-hbase4.apache.org/44565] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-23 10:08:50,528 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-23 10:08:50,528 INFO [Listener at jenkins-hbase4.apache.org/44565] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-23 10:08:50,528 INFO [Listener at jenkins-hbase4.apache.org/44565] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-23 10:08:50,528 INFO [Listener at jenkins-hbase4.apache.org/44565] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-23 10:08:50,528 DEBUG [Listener at jenkins-hbase4.apache.org/44565] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x207f6c1a to 127.0.0.1:55181 2023-07-23 10:08:50,529 DEBUG [Listener at jenkins-hbase4.apache.org/44565] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 10:08:50,529 DEBUG [Listener at jenkins-hbase4.apache.org/44565] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-23 10:08:50,529 DEBUG [Listener at jenkins-hbase4.apache.org/44565] util.JVMClusterUtil(257): Found active master hash=1245815773, stopped=false 2023-07-23 10:08:50,529 DEBUG [Listener at jenkins-hbase4.apache.org/44565] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 10:08:50,529 DEBUG [Listener at jenkins-hbase4.apache.org/44565] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-23 10:08:50,529 INFO [Listener at jenkins-hbase4.apache.org/44565] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,34097,1690106766220 2023-07-23 10:08:50,531 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-23 10:08:50,531 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-23 10:08:50,531 INFO [Listener at jenkins-hbase4.apache.org/44565] procedure2.ProcedureExecutor(629): Stopping 2023-07-23 10:08:50,531 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-23 10:08:50,531 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-23 10:08:50,531 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-23 10:08:50,532 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-23 10:08:50,532 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-23 10:08:50,532 DEBUG [Listener at jenkins-hbase4.apache.org/44565] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x636fe554 to 127.0.0.1:55181 2023-07-23 10:08:50,533 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-23 10:08:50,532 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-23 10:08:50,533 DEBUG [Listener at jenkins-hbase4.apache.org/44565] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 10:08:50,533 INFO [Listener at jenkins-hbase4.apache.org/44565] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,36599,1690106767729' ***** 2023-07-23 10:08:50,533 DEBUG [Listener at jenkins-hbase4.apache.org/44565] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 10:08:50,533 INFO [Listener at jenkins-hbase4.apache.org/44565] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-23 10:08:50,533 INFO [Listener at jenkins-hbase4.apache.org/44565] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,39563,1690106767800' ***** 2023-07-23 10:08:50,533 DEBUG [Listener at jenkins-hbase4.apache.org/44565] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 10:08:50,534 INFO [Listener at jenkins-hbase4.apache.org/44565] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-23 10:08:50,534 INFO [Listener at jenkins-hbase4.apache.org/44565] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,36827,1690106767853' ***** 2023-07-23 10:08:50,534 DEBUG [Listener at jenkins-hbase4.apache.org/44565] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 10:08:50,534 INFO [Listener at jenkins-hbase4.apache.org/44565] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-23 10:08:50,534 INFO [RS:0;jenkins-hbase4:36599] regionserver.HeapMemoryManager(220): Stopping 2023-07-23 10:08:50,534 INFO [RS:1;jenkins-hbase4:39563] regionserver.HeapMemoryManager(220): Stopping 2023-07-23 10:08:50,534 INFO [RS:1;jenkins-hbase4:39563] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-23 10:08:50,534 INFO [RS:1;jenkins-hbase4:39563] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-23 10:08:50,535 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-23 10:08:50,535 INFO [RS:1;jenkins-hbase4:39563] regionserver.HRegionServer(3305): Received CLOSE for eaf9a3ac32c2b3d5414d70aa7cd9cde4 2023-07-23 10:08:50,535 INFO [RS:1;jenkins-hbase4:39563] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:08:50,535 DEBUG [RS:1;jenkins-hbase4:39563] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x68e8f323 to 127.0.0.1:55181 2023-07-23 10:08:50,535 DEBUG [RS:1;jenkins-hbase4:39563] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 10:08:50,537 INFO [RS:1;jenkins-hbase4:39563] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-23 10:08:50,537 INFO [RS:1;jenkins-hbase4:39563] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-23 10:08:50,537 INFO [RS:1;jenkins-hbase4:39563] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-23 10:08:50,537 INFO [RS:1;jenkins-hbase4:39563] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-23 10:08:50,538 INFO [RS:1;jenkins-hbase4:39563] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-07-23 10:08:50,541 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-23 10:08:50,541 INFO [RS:0;jenkins-hbase4:36599] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-23 10:08:50,541 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-23 10:08:50,541 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-23 10:08:50,541 DEBUG [RS:1;jenkins-hbase4:39563] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740, eaf9a3ac32c2b3d5414d70aa7cd9cde4=hbase:acl,,1690106771241.eaf9a3ac32c2b3d5414d70aa7cd9cde4.} 2023-07-23 10:08:50,541 INFO [RS:2;jenkins-hbase4:36827] regionserver.HeapMemoryManager(220): Stopping 2023-07-23 10:08:50,541 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing eaf9a3ac32c2b3d5414d70aa7cd9cde4, disabling compactions & flushes 2023-07-23 10:08:50,541 INFO [RS:2;jenkins-hbase4:36827] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-23 10:08:50,541 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-23 10:08:50,541 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-23 10:08:50,541 INFO [RS:0;jenkins-hbase4:36599] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-23 10:08:50,541 INFO [RS:2;jenkins-hbase4:36827] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-23 10:08:50,542 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-23 10:08:50,541 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1690106771241.eaf9a3ac32c2b3d5414d70aa7cd9cde4. 2023-07-23 10:08:50,542 INFO [RS:2;jenkins-hbase4:36827] regionserver.HRegionServer(3305): Received CLOSE for 4b59e3c0171366eb285c3dc1e37b4112 2023-07-23 10:08:50,542 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1690106771241.eaf9a3ac32c2b3d5414d70aa7cd9cde4. 2023-07-23 10:08:50,542 INFO [RS:2;jenkins-hbase4:36827] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:08:50,542 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-23 10:08:50,542 INFO [RS:0;jenkins-hbase4:36599] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:08:50,542 DEBUG [RS:2;jenkins-hbase4:36827] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x12974ff8 to 127.0.0.1:55181 2023-07-23 10:08:50,542 DEBUG [RS:1;jenkins-hbase4:39563] regionserver.HRegionServer(1504): Waiting on 1588230740, eaf9a3ac32c2b3d5414d70aa7cd9cde4 2023-07-23 10:08:50,542 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1690106771241.eaf9a3ac32c2b3d5414d70aa7cd9cde4. after waiting 0 ms 2023-07-23 10:08:50,542 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1690106771241.eaf9a3ac32c2b3d5414d70aa7cd9cde4. 2023-07-23 10:08:50,542 DEBUG [RS:2;jenkins-hbase4:36827] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 10:08:50,542 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing eaf9a3ac32c2b3d5414d70aa7cd9cde4 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-23 10:08:50,542 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-23 10:08:50,542 DEBUG [RS:0;jenkins-hbase4:36599] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x725e318c to 127.0.0.1:55181 2023-07-23 10:08:50,543 DEBUG [RS:0;jenkins-hbase4:36599] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 10:08:50,551 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4b59e3c0171366eb285c3dc1e37b4112, disabling compactions & flushes 2023-07-23 10:08:50,552 INFO [RS:2;jenkins-hbase4:36827] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-23 10:08:50,552 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1690106770502.4b59e3c0171366eb285c3dc1e37b4112. 2023-07-23 10:08:50,552 INFO [RS:0;jenkins-hbase4:36599] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,36599,1690106767729; all regions closed. 2023-07-23 10:08:50,552 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1690106770502.4b59e3c0171366eb285c3dc1e37b4112. 2023-07-23 10:08:50,552 DEBUG [RS:2;jenkins-hbase4:36827] regionserver.HRegionServer(1478): Online Regions={4b59e3c0171366eb285c3dc1e37b4112=hbase:namespace,,1690106770502.4b59e3c0171366eb285c3dc1e37b4112.} 2023-07-23 10:08:50,553 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1690106770502.4b59e3c0171366eb285c3dc1e37b4112. after waiting 0 ms 2023-07-23 10:08:50,553 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1690106770502.4b59e3c0171366eb285c3dc1e37b4112. 2023-07-23 10:08:50,553 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 4b59e3c0171366eb285c3dc1e37b4112 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-23 10:08:50,553 DEBUG [RS:2;jenkins-hbase4:36827] regionserver.HRegionServer(1504): Waiting on 4b59e3c0171366eb285c3dc1e37b4112 2023-07-23 10:08:50,569 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-23 10:08:50,576 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-23 10:08:50,576 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-23 10:08:50,599 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/hbase/meta/1588230740/.tmp/info/493ba90a7bed41a2940dd4963cd393c5 2023-07-23 10:08:50,610 DEBUG [RS:0;jenkins-hbase4:36599] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/oldWALs 2023-07-23 10:08:50,610 INFO [RS:0;jenkins-hbase4:36599] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C36599%2C1690106767729:(num 1690106769960) 2023-07-23 10:08:50,610 DEBUG [RS:0;jenkins-hbase4:36599] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 10:08:50,610 INFO [RS:0;jenkins-hbase4:36599] regionserver.LeaseManager(133): Closed leases 2023-07-23 10:08:50,611 INFO [RS:0;jenkins-hbase4:36599] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-23 10:08:50,611 INFO [RS:0;jenkins-hbase4:36599] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-23 10:08:50,611 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-23 10:08:50,611 INFO [RS:0;jenkins-hbase4:36599] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-23 10:08:50,611 INFO [RS:0;jenkins-hbase4:36599] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-23 10:08:50,613 INFO [RS:0;jenkins-hbase4:36599] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:36599 2023-07-23 10:08:50,613 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 493ba90a7bed41a2940dd4963cd393c5 2023-07-23 10:08:50,614 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/hbase/namespace/4b59e3c0171366eb285c3dc1e37b4112/.tmp/info/e3f750c151594bcaa52ffb86ffa1e123 2023-07-23 10:08:50,615 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/hbase/acl/eaf9a3ac32c2b3d5414d70aa7cd9cde4/.tmp/l/22065e02c3eb434daab75da5460fdb08 2023-07-23 10:08:50,620 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:08:50,620 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-23 10:08:50,620 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:08:50,620 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36599,1690106767729 2023-07-23 10:08:50,620 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-23 10:08:50,620 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-23 10:08:50,622 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/hbase/namespace/4b59e3c0171366eb285c3dc1e37b4112/.tmp/info/e3f750c151594bcaa52ffb86ffa1e123 as hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/hbase/namespace/4b59e3c0171366eb285c3dc1e37b4112/info/e3f750c151594bcaa52ffb86ffa1e123 2023-07-23 10:08:50,626 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-23 10:08:50,629 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 22065e02c3eb434daab75da5460fdb08 2023-07-23 10:08:50,630 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/hbase/acl/eaf9a3ac32c2b3d5414d70aa7cd9cde4/.tmp/l/22065e02c3eb434daab75da5460fdb08 as hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/hbase/acl/eaf9a3ac32c2b3d5414d70aa7cd9cde4/l/22065e02c3eb434daab75da5460fdb08 2023-07-23 10:08:50,637 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 22065e02c3eb434daab75da5460fdb08 2023-07-23 10:08:50,637 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/hbase/acl/eaf9a3ac32c2b3d5414d70aa7cd9cde4/l/22065e02c3eb434daab75da5460fdb08, entries=7, sequenceid=18, filesize=5.2 K 2023-07-23 10:08:50,639 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/hbase/namespace/4b59e3c0171366eb285c3dc1e37b4112/info/e3f750c151594bcaa52ffb86ffa1e123, entries=2, sequenceid=6, filesize=4.8 K 2023-07-23 10:08:50,639 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for eaf9a3ac32c2b3d5414d70aa7cd9cde4 in 97ms, sequenceid=18, compaction requested=false 2023-07-23 10:08:50,640 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 4b59e3c0171366eb285c3dc1e37b4112 in 87ms, sequenceid=6, compaction requested=false 2023-07-23 10:08:50,651 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/hbase/meta/1588230740/.tmp/rep_barrier/7307c2ddbee24ccbb689b2463cee9834 2023-07-23 10:08:50,655 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/hbase/namespace/4b59e3c0171366eb285c3dc1e37b4112/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-23 10:08:50,655 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 10:08:50,656 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1690106770502.4b59e3c0171366eb285c3dc1e37b4112. 2023-07-23 10:08:50,656 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4b59e3c0171366eb285c3dc1e37b4112: 2023-07-23 10:08:50,656 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1690106770502.4b59e3c0171366eb285c3dc1e37b4112. 2023-07-23 10:08:50,657 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/hbase/acl/eaf9a3ac32c2b3d5414d70aa7cd9cde4/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-23 10:08:50,657 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7307c2ddbee24ccbb689b2463cee9834 2023-07-23 10:08:50,658 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 10:08:50,658 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1690106771241.eaf9a3ac32c2b3d5414d70aa7cd9cde4. 2023-07-23 10:08:50,658 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for eaf9a3ac32c2b3d5414d70aa7cd9cde4: 2023-07-23 10:08:50,658 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1690106771241.eaf9a3ac32c2b3d5414d70aa7cd9cde4. 2023-07-23 10:08:50,673 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/hbase/meta/1588230740/.tmp/table/5ed1829bfc9b44b7a1b7ad4f09d0abac 2023-07-23 10:08:50,678 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5ed1829bfc9b44b7a1b7ad4f09d0abac 2023-07-23 10:08:50,679 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/hbase/meta/1588230740/.tmp/info/493ba90a7bed41a2940dd4963cd393c5 as hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/hbase/meta/1588230740/info/493ba90a7bed41a2940dd4963cd393c5 2023-07-23 10:08:50,683 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 493ba90a7bed41a2940dd4963cd393c5 2023-07-23 10:08:50,683 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/hbase/meta/1588230740/info/493ba90a7bed41a2940dd4963cd393c5, entries=48, sequenceid=131, filesize=10.3 K 2023-07-23 10:08:50,684 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/hbase/meta/1588230740/.tmp/rep_barrier/7307c2ddbee24ccbb689b2463cee9834 as hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/hbase/meta/1588230740/rep_barrier/7307c2ddbee24ccbb689b2463cee9834 2023-07-23 10:08:50,688 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7307c2ddbee24ccbb689b2463cee9834 2023-07-23 10:08:50,688 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/hbase/meta/1588230740/rep_barrier/7307c2ddbee24ccbb689b2463cee9834, entries=13, sequenceid=131, filesize=6.4 K 2023-07-23 10:08:50,689 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/hbase/meta/1588230740/.tmp/table/5ed1829bfc9b44b7a1b7ad4f09d0abac as hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/hbase/meta/1588230740/table/5ed1829bfc9b44b7a1b7ad4f09d0abac 2023-07-23 10:08:50,693 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5ed1829bfc9b44b7a1b7ad4f09d0abac 2023-07-23 10:08:50,693 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/hbase/meta/1588230740/table/5ed1829bfc9b44b7a1b7ad4f09d0abac, entries=24, sequenceid=131, filesize=6.9 K 2023-07-23 10:08:50,694 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 152ms, sequenceid=131, compaction requested=false 2023-07-23 10:08:50,715 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-23 10:08:50,715 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 10:08:50,716 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-23 10:08:50,716 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-23 10:08:50,716 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-23 10:08:50,716 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-23 10:08:50,723 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-23 10:08:50,723 INFO [RS:0;jenkins-hbase4:36599] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,36599,1690106767729; zookeeper connection closed. 2023-07-23 10:08:50,723 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36599-0x10191a522dc0001, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-23 10:08:50,723 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,36599,1690106767729] 2023-07-23 10:08:50,724 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@6bfd4cb9] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@6bfd4cb9 2023-07-23 10:08:50,724 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,36599,1690106767729; numProcessing=1 2023-07-23 10:08:50,726 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,36599,1690106767729 already deleted, retry=false 2023-07-23 10:08:50,726 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,36599,1690106767729 expired; onlineServers=2 2023-07-23 10:08:50,742 INFO [RS:1;jenkins-hbase4:39563] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,39563,1690106767800; all regions closed. 2023-07-23 10:08:50,749 DEBUG [RS:1;jenkins-hbase4:39563] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/oldWALs 2023-07-23 10:08:50,749 INFO [RS:1;jenkins-hbase4:39563] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39563%2C1690106767800.meta:.meta(num 1690106770196) 2023-07-23 10:08:50,753 INFO [RS:2;jenkins-hbase4:36827] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,36827,1690106767853; all regions closed. 2023-07-23 10:08:50,768 DEBUG [RS:1;jenkins-hbase4:39563] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/oldWALs 2023-07-23 10:08:50,769 INFO [RS:1;jenkins-hbase4:39563] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39563%2C1690106767800:(num 1690106769957) 2023-07-23 10:08:50,769 DEBUG [RS:2;jenkins-hbase4:36827] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/oldWALs 2023-07-23 10:08:50,769 INFO [RS:2;jenkins-hbase4:36827] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C36827%2C1690106767853:(num 1690106769956) 2023-07-23 10:08:50,769 DEBUG [RS:2;jenkins-hbase4:36827] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 10:08:50,769 DEBUG [RS:1;jenkins-hbase4:39563] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 10:08:50,769 INFO [RS:2;jenkins-hbase4:36827] regionserver.LeaseManager(133): Closed leases 2023-07-23 10:08:50,769 INFO [RS:1;jenkins-hbase4:39563] regionserver.LeaseManager(133): Closed leases 2023-07-23 10:08:50,769 INFO [RS:2;jenkins-hbase4:36827] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-23 10:08:50,769 INFO [RS:1;jenkins-hbase4:39563] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-23 10:08:50,770 INFO [RS:2;jenkins-hbase4:36827] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-23 10:08:50,770 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-23 10:08:50,770 INFO [RS:2;jenkins-hbase4:36827] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-23 10:08:50,770 INFO [RS:2;jenkins-hbase4:36827] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-23 10:08:50,771 INFO [RS:2;jenkins-hbase4:36827] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:36827 2023-07-23 10:08:50,771 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-23 10:08:50,772 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:08:50,772 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36827,1690106767853 2023-07-23 10:08:50,772 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-23 10:08:50,774 INFO [RS:1;jenkins-hbase4:39563] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39563 2023-07-23 10:08:50,774 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,36827,1690106767853] 2023-07-23 10:08:50,775 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,36827,1690106767853; numProcessing=2 2023-07-23 10:08:50,775 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39563,1690106767800 2023-07-23 10:08:50,775 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-23 10:08:50,875 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-23 10:08:50,875 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:36827-0x10191a522dc0003, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-23 10:08:50,875 INFO [RS:2;jenkins-hbase4:36827] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,36827,1690106767853; zookeeper connection closed. 2023-07-23 10:08:50,878 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,36827,1690106767853 already deleted, retry=false 2023-07-23 10:08:50,878 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,36827,1690106767853 expired; onlineServers=1 2023-07-23 10:08:50,879 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,39563,1690106767800] 2023-07-23 10:08:50,879 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,39563,1690106767800; numProcessing=3 2023-07-23 10:08:50,879 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@2f1ccc94] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@2f1ccc94 2023-07-23 10:08:50,880 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,39563,1690106767800 already deleted, retry=false 2023-07-23 10:08:50,881 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,39563,1690106767800 expired; onlineServers=0 2023-07-23 10:08:50,881 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,34097,1690106766220' ***** 2023-07-23 10:08:50,881 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-23 10:08:50,881 DEBUG [M:0;jenkins-hbase4:34097] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@b7ca9e6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-23 10:08:50,881 INFO [M:0;jenkins-hbase4:34097] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,34097,1690106766220 2023-07-23 10:08:50,881 INFO [M:0;jenkins-hbase4:34097] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,34097,1690106766220; all regions closed. 2023-07-23 10:08:50,881 DEBUG [M:0;jenkins-hbase4:34097] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 10:08:50,881 DEBUG [M:0;jenkins-hbase4:34097] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-23 10:08:50,881 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-23 10:08:50,881 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1690106769479] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1690106769479,5,FailOnTimeoutGroup] 2023-07-23 10:08:50,881 DEBUG [M:0;jenkins-hbase4:34097] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-23 10:08:50,882 INFO [M:0;jenkins-hbase4:34097] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-23 10:08:50,882 INFO [M:0;jenkins-hbase4:34097] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-23 10:08:50,882 INFO [M:0;jenkins-hbase4:34097] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-07-23 10:08:50,882 DEBUG [M:0;jenkins-hbase4:34097] master.HMaster(1512): Stopping service threads 2023-07-23 10:08:50,882 INFO [M:0;jenkins-hbase4:34097] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-23 10:08:50,881 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1690106769478] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1690106769478,5,FailOnTimeoutGroup] 2023-07-23 10:08:50,882 ERROR [M:0;jenkins-hbase4:34097] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-23 10:08:50,883 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-23 10:08:50,883 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-23 10:08:50,883 INFO [M:0;jenkins-hbase4:34097] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-23 10:08:50,883 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-23 10:08:50,884 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-23 10:08:50,884 DEBUG [M:0;jenkins-hbase4:34097] zookeeper.ZKUtil(398): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-23 10:08:50,884 WARN [M:0;jenkins-hbase4:34097] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-23 10:08:50,884 INFO [M:0;jenkins-hbase4:34097] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-23 10:08:50,884 INFO [M:0;jenkins-hbase4:34097] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-23 10:08:50,885 DEBUG [M:0;jenkins-hbase4:34097] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-23 10:08:50,885 INFO [M:0;jenkins-hbase4:34097] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-23 10:08:50,885 DEBUG [M:0;jenkins-hbase4:34097] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-23 10:08:50,885 DEBUG [M:0;jenkins-hbase4:34097] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-23 10:08:50,885 DEBUG [M:0;jenkins-hbase4:34097] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-23 10:08:50,885 INFO [M:0;jenkins-hbase4:34097] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.64 KB heapSize=451.86 KB 2023-07-23 10:08:50,978 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-23 10:08:50,978 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): regionserver:39563-0x10191a522dc0002, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-23 10:08:50,980 INFO [RS:1;jenkins-hbase4:39563] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,39563,1690106767800; zookeeper connection closed. 2023-07-23 10:08:50,982 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@382ced2] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@382ced2 2023-07-23 10:08:50,982 INFO [Listener at jenkins-hbase4.apache.org/44565] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-23 10:08:50,987 INFO [M:0;jenkins-hbase4:34097] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.64 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/568eeb3bbdd341dd89e3cbcc48eac710 2023-07-23 10:08:50,999 INFO [M:0;jenkins-hbase4:34097] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 568eeb3bbdd341dd89e3cbcc48eac710 2023-07-23 10:08:51,002 DEBUG [M:0;jenkins-hbase4:34097] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/568eeb3bbdd341dd89e3cbcc48eac710 as hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/568eeb3bbdd341dd89e3cbcc48eac710 2023-07-23 10:08:51,008 INFO [M:0;jenkins-hbase4:34097] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 568eeb3bbdd341dd89e3cbcc48eac710 2023-07-23 10:08:51,008 INFO [M:0;jenkins-hbase4:34097] regionserver.HStore(1080): Added hdfs://localhost:37479/user/jenkins/test-data/574e9167-2168-41af-8055-a4cc66fe1528/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/568eeb3bbdd341dd89e3cbcc48eac710, entries=119, sequenceid=899, filesize=28.6 K 2023-07-23 10:08:51,009 INFO [M:0;jenkins-hbase4:34097] regionserver.HRegion(2948): Finished flush of dataSize ~375.64 KB/384655, heapSize ~451.84 KB/462688, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 124ms, sequenceid=899, compaction requested=false 2023-07-23 10:08:51,013 INFO [M:0;jenkins-hbase4:34097] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-23 10:08:51,013 DEBUG [M:0;jenkins-hbase4:34097] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-23 10:08:51,018 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-23 10:08:51,019 INFO [M:0;jenkins-hbase4:34097] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-23 10:08:51,019 INFO [M:0;jenkins-hbase4:34097] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34097 2023-07-23 10:08:51,021 DEBUG [M:0;jenkins-hbase4:34097] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,34097,1690106766220 already deleted, retry=false 2023-07-23 10:08:51,123 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-23 10:08:51,123 INFO [M:0;jenkins-hbase4:34097] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,34097,1690106766220; zookeeper connection closed. 2023-07-23 10:08:51,123 DEBUG [Listener at localhost/45567-EventThread] zookeeper.ZKWatcher(600): master:34097-0x10191a522dc0000, quorum=127.0.0.1:55181, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-23 10:08:51,125 WARN [Listener at jenkins-hbase4.apache.org/44565] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-23 10:08:51,150 INFO [Listener at jenkins-hbase4.apache.org/44565] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-23 10:08:51,254 WARN [BP-805053481-172.31.14.131-1690106762112 heartbeating to localhost/127.0.0.1:37479] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-23 10:08:51,254 WARN [BP-805053481-172.31.14.131-1690106762112 heartbeating to localhost/127.0.0.1:37479] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-805053481-172.31.14.131-1690106762112 (Datanode Uuid 37cc602f-d241-446f-938d-d9fb338e9fcb) service to localhost/127.0.0.1:37479 2023-07-23 10:08:51,256 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f0c2d64d-3350-bc69-1c38-d6964a44400f/cluster_e785ae9c-bfd7-c886-b4ec-cc83daa5c072/dfs/data/data5/current/BP-805053481-172.31.14.131-1690106762112] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-23 10:08:51,256 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f0c2d64d-3350-bc69-1c38-d6964a44400f/cluster_e785ae9c-bfd7-c886-b4ec-cc83daa5c072/dfs/data/data6/current/BP-805053481-172.31.14.131-1690106762112] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-23 10:08:51,257 WARN [Listener at jenkins-hbase4.apache.org/44565] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-23 10:08:51,260 INFO [Listener at jenkins-hbase4.apache.org/44565] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-23 10:08:51,264 WARN [BP-805053481-172.31.14.131-1690106762112 heartbeating to localhost/127.0.0.1:37479] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-23 10:08:51,264 WARN [BP-805053481-172.31.14.131-1690106762112 heartbeating to localhost/127.0.0.1:37479] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-805053481-172.31.14.131-1690106762112 (Datanode Uuid 8fbd0bda-7ff5-470b-8e73-ab8afc9106c9) service to localhost/127.0.0.1:37479 2023-07-23 10:08:51,269 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f0c2d64d-3350-bc69-1c38-d6964a44400f/cluster_e785ae9c-bfd7-c886-b4ec-cc83daa5c072/dfs/data/data4/current/BP-805053481-172.31.14.131-1690106762112] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-23 10:08:51,269 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f0c2d64d-3350-bc69-1c38-d6964a44400f/cluster_e785ae9c-bfd7-c886-b4ec-cc83daa5c072/dfs/data/data3/current/BP-805053481-172.31.14.131-1690106762112] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-23 10:08:51,271 WARN [Listener at jenkins-hbase4.apache.org/44565] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-23 10:08:51,278 INFO [Listener at jenkins-hbase4.apache.org/44565] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-23 10:08:51,381 WARN [BP-805053481-172.31.14.131-1690106762112 heartbeating to localhost/127.0.0.1:37479] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-23 10:08:51,382 WARN [BP-805053481-172.31.14.131-1690106762112 heartbeating to localhost/127.0.0.1:37479] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-805053481-172.31.14.131-1690106762112 (Datanode Uuid b8de142a-8a37-42a9-8af2-06bf50ff65b1) service to localhost/127.0.0.1:37479 2023-07-23 10:08:51,382 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f0c2d64d-3350-bc69-1c38-d6964a44400f/cluster_e785ae9c-bfd7-c886-b4ec-cc83daa5c072/dfs/data/data1/current/BP-805053481-172.31.14.131-1690106762112] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-23 10:08:51,383 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f0c2d64d-3350-bc69-1c38-d6964a44400f/cluster_e785ae9c-bfd7-c886-b4ec-cc83daa5c072/dfs/data/data2/current/BP-805053481-172.31.14.131-1690106762112] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-23 10:08:51,410 INFO [Listener at jenkins-hbase4.apache.org/44565] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-23 10:08:51,564 INFO [Listener at jenkins-hbase4.apache.org/44565] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-23 10:08:51,659 INFO [Listener at jenkins-hbase4.apache.org/44565] hbase.HBaseTestingUtility(1293): Minicluster is down